BNSF | Tech is looking to transform its data assets into a real-time enterprise by leading the charge into the future as an AI company.
Requirements
- Minimum 5 years experience in software engineering, data engineering, database management or relevant experience
- Proficiency in programming languages such as Python, SQL, Java
- Strong understanding of data warehousing concepts including dimensional modeling and star schema.
- Experience with ETL processes and tools including cloud based solutions
- Familiarity with database management systems (e.g., SQL, NoSQL) and modern lakehouse technologies (eg. Apache Iceberg, Delta Lake, Apache Trino)
- Experience with data streaming technologies (e.g., Apache Kafka, AWS Kinesis, Apache Flink and Apache Spark)
- Experience in data engineering, with a focus on data streaming, data pipelines, data orchestration tools, datamart creation, and certified datasets
Responsibilities
- Design and implement data streaming solutions to process real-time data efficiently.
- Develop and maintain robust data pipelines for both real time and batch processing including data extraction, transformation and ETL processes to ensure seamless data flow across systems.
- Create and manage large scale data warehouses to ensure efficient data access and retrieval in support of business intelligence and analytics needs.
- Develop certified datasets by integrating data from diverse data sources to ensure data accuracy, consistency and reliability.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective data solutions.
- Optimize data workflows, monitor data pipelines and troubleshoot issues to ensure high performance, reliable and scalable data flows.
- Ensure data security and compliance with industry standards and regulations.
Other
- be part of a team that values safety, inclusion, and excellence
- Employees may work from anywhere within the contiguous 48 states of the United States
- Travel is up to 20%.
- All positions require pre-employment background verification.
- BNSF Railway is an Equal Opportunity Employer, all qualified applicants receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.
