Freedom Technology Solutions Group is looking to add a Data Engineer to the team to fulfill data integration requirements and collaborate closely with a team of developers.
Requirements
Experience building ETL pipelines, managing data pipelines, and working with large datasets using tools like Spark, Python, and SQL
Experience with technologies like Delta Lake, Delta Live Tables, and Databricks Workflows
Strong Python programming skills
Solid SQL knowledge for querying and data manipulation
Cloud platform experience, such as AWS, Azure, etc
Familiarity with Advana
Specialization using the Databricks platform for building, deploying, and managing data and AI solutions
Responsibilities
writing and maintaining code using an Extract-Transform-Load (ETL) platform
enhancing the ETL platform by adding features aimed at shortening timelines for future data integration efforts
developing and maintaining software, ensuring seamless integration into a fully functional system
collaborating with external teams to validate data ingest processes
providing comprehensive documentation covering system architecture, development, and any enhancements made throughout the process
building, deploying, and managing data and AI solutions using the Databricks platform
collecting data efficiently using various protocols including HTML and SFTP
Other
Active Security Clearance
5+ years of professional experience with a Bachelor's degree or equivalent
3+ years of professional experience with a Master's degree or equivalent
10+ years of professional experience
Additional experience will be considered in lieu of a degree
