LTK is looking to empower the world's premium lifestyle Creators to achieve maximum economic success by building and optimizing their data lakehouse, ensuring data reliability and quality, and driving the strategic direction of their data engineering technology stack.
Requirements
- 3-5 years of experience in building data pipelines, coding for data management, data warehousing, or other data environments.
- Experience in system design and application architecture for data platforms;
- Experience driving end-to-end ETL data pipelines, from ingestion of data to consumption by business intelligence, analytics, and other data consumer teams
- Strong experience in Python programming at a minimum, with demonstrated real-world experience building out data tools in Cloud environments
- Knowledge in SQL fine-tuning, optimizers, and execution plans;
- Experience transforming datasets of Terabyte scale to reporting data models
- Proven experience working with AWS cloud computing environment. Knowledge of AWS Data services ( Redshift, S3, MWAA, Glue, Athena, Kinesis, etc.)
Responsibilities
- Contribute to the technical definition, prototyping, and production-ready enablement of LTK's data lakehouse, optimizing efficiencies, performance, scale, and cost
- Support the governance of LTK's data lakehouse
- Participate in the overall strategic direction of the data engineering technology stack
- Stay abreast of data engineering technical trends and emerging approaches
- Evaluate new technologies and/or custom solutions
- Build required infrastructure for optimal ETL/ELT processes for data from various data sources using AWS, SQL, and orchestration technologies.
- Ensure the reliability and quality of data across the data lake (at rest) and in the pipelines (in motion)
Other
- Effectively communicate and gain alignment both within the team and with interdependent teams and stakeholders
- Produce high-quality technical documentation and artifacts that are easily consumable by data teams and other engineering teams
- Experience with Data management and Data governance processes and standards;
- A mindset focused on seizing opportunities and moving with urgency
- Adaptability to a dynamic, fast-moving environment
