Ascent Developer Solutions is seeking a Data Engineering Associate to contribute to the development and maintenance of data pipelines and solutions within their Azure cloud environment, supporting their nationwide real estate lending platform.
Requirements
- 2+ years of hands-on experience with Databricks, Python, SQL, Azure Data factory, ADLS, GitHub, ETL/ELT process
- Knowledge of CI/CD
- Azure cloud services
- Azure Databricks
- Python
- SQL
- Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics
Responsibilities
- Contribute to data pipeline development: Assist in the design, construction, and maintenance of ETL/ELT data pipelines using Python and Azure services, working under the guidance of senior engineers.
- Support data processing with Python: Utilize Python and basic PySpark for data processing, cleansing, and transformation tasks within Azure Databricks notebooks.
- Perform SQL tasks: Write and optimize SQL queries for data extraction and analysis from modern data warehouses and databases.
- Learn and apply cloud services: Develop foundational knowledge and hands-on experience with Azure cloud services, including Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.
- Gain version control experience: Use Git for version control to manage code and collaborate with the engineering team.
- Troubleshoot and monitor: Assist with monitoring data pipelines and troubleshooting data flow issues in development and production environments.
- Ensure data quality: Help implement data quality checks and validation processes to ensure the accuracy and integrity of data.
Other
- This role works on-site from Ascent's Encino offices 2-3 days/week and remotely from southern California otherwise.
- Full-time, 40 hours per week; must be available for occasional overtime.
- Some nights and weekends required.
- Take initiative to learn: Demonstrate curiosity and a proactive attitude toward learning new tools and methodologies in a dynamic, fast-paced environment.
- Adaptability: Show the ability to quickly adapt to new data technologies and contribute to process improvements.
