Accenture Federal Services is looking to solve the problem of bringing governance policies to life through technology, specifically by developing and maintaining systems that connect data sources to an enterprise data catalog, automating metadata collection and lineage, and building a foundation of trust and transparency in data.
Requirements
- 4+ years of hands-on experience in a data engineering role.
- Strong programming proficiency in Python and advanced SQL.
- Experience building and maintaining data pipelines and ETL/ELT processes.
- Hands-on experience working with REST APIs to integrate different systems.
- Experience with cloud data platforms (e.g., Databricks, Snowflake, AWS S3, Azure Data Lake).
- A foundational understanding of metadata management and data governance concepts.
- Hands-on experience developing integrations for an enterprise data catalog platform (e.g., Collibra, Alation).
Responsibilities
- Develop, maintain, and enhance data pipelines that automatically harvest metadata from various data sources (e.g., databases, data lakes, APIs) and ingest it into the enterprise data catalog (e.g., Collibra).
- Implement custom integrations using the data catalog's APIs and SDKs to connect with platforms like Databricks, Snowflake, and S3.
- Work with senior engineers and analysts to implement technical data quality rules and monitoring solutions within data pipelines.
- Support the technical administration and operational health of the data catalog platform, troubleshooting ingestion issues and ensuring system stability.
- Write and maintain clear, concise documentation for the data pipelines and integrations you build.
- Collaborate with data source owners and other engineering teams to ensure successful metadata extraction and lineage tracing.
- Contribute to the scripting and automation of recurring data governance tasks.
Other
- US Citizenship (No Dual Citizenship).
- Active TS and TS/SCI clearance
- Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.
