BNSF | Tech is looking to transform its data assets into a real-time enterprise by leading the charge into the future as an AI company.
Requirements
- Minimum 6 years experience in software engineering, data engineering, database management or relevant experience
- Proficiency in programming languages such as Python, SQL, Java
- Strong understanding of data warehousing concepts including dimensional modeling and star schema.
- Experience with ETL processes and tools including cloud based solutions
- Familiarity with database management systems (e.g., SQL, NoSQL) and modern lakehouse technologies (eg. Apache Iceberg, Delta Lake, Apache Trino)
- Experience with data streaming technologies (e.g., Apache Kafka, AWS Kinesis, Apache Flink and Apache Spark)
- Experience in DevSecOps standards, source control systems and tools like Jenkins, GitHub
Responsibilities
- Design and implement data streaming solutions to process real-time data efficiently.
- Develop and maintain robust data pipelines for both real time and batch processing including data extraction, transformation and ETL processes to ensure seamless data flow across systems.
- Create and manage large scale data warehouses to ensure efficient data access and retrieval in support of business intelligence and analytics needs.
- Develop certified datasets by integrating data from diverse data sources to ensure data accuracy, consistency and reliability.
- Optimize data workflows, monitor data pipelines and troubleshoot issues to ensure high performance, reliable and scalable data flows.
- Ensure data security and compliance with industry standards and regulations.
- Implement data engineering solutions into data platforms or production systems by leading the solution design, development, testing, and monitoring
Other
- Employees may work from anywhere within the contiguous 48 states of the United States
- Travel is up to 20%. Employees will be required to occasionally travel to our corporate headquarters in Fort Worth, TX for in person meetings.
- Excellent problem-solving skills and attention to detail
- Strong communication and collaboration skills
- Intellectual curiosity and ability to thrive in a team environment that is constantly changing
