QSC is seeking a Senior Data Engineer/Data Architect to design, build, and maintain data infrastructure, lead strategic architectural initiatives, and ensure scalability, security, and efficiency in managing data resources to support QSC's mission of becoming a data-driven enterprise.
Requirements
- Deep expertise in database technologies (SQL, NoSQL), data modeling (e.g., Star Schema, Snowflake), and distributed data systems (e.g., Hadoop, Spark).
- Strong proficiency in Azure cloud-based data solutions and related infrastructure (Azure, MS Fabric, Azure Synapse, and Databricks.)
- Expertise in ETL/ELT frameworks and tools.
- Strong coding skills in languages like Python or Scala for building and optimizing data pipelines.
- Expertise in building and securing RESTful APIs, as well as integrating with APIs from third-party services.
- Strong familiarity with microservices architecture and how to design for scalability, resiliency, and modularity.
- Experience working with middleware solutions and integrating legacy systems into modern data architectures.
Responsibilities
- Design and implement scalable data architectures that meet the needs of QSC's growing data landscape, ensuring flexibility, performance, and security.
- Build, optimize, and manage ETL/ELT processes to ensure efficient data flow between systems, applications, and data warehouses.
- Develop and maintain robust data pipelines for both structured and unstructured data sources, ensuring data is processed efficiently and made available to business users.
- Build and deploy APIs for seamless integration and consumption of data across different platforms, ensuring security, performance, and scalability.
- Leverage middleware to integrate legacy systems with modern data platforms, ensuring smooth data flow between services.
- Collaborate with software engineering teams to implement data solutions that meet performance and scalability requirements.
- Establish data quality metrics and ensure compliance with data governance policies across the organization.
Other
- Minimum: Bachelor's Degree in Computer Science, Engineering, Information Systems, or a related field.
- Preferred: Master's Degree in Computer Science, Data Science, or equivalent technical discipline
- 8+ years of hands-on experience in data engineering, data architecture, or related fields.
- Strong communication skills with the ability to explain complex technical solutions to business stakeholders.
- Excellent problem-solving skills and ability to design creative, scalable data solutions.