GM Marketing Organizations need analytics-driven solutions to achieve their business goals. The Staff Data Engineer role is responsible for designing, developing and maintaining data pipelines, databases and data infrastructure to enable the efficient data collection, storage and analysis in support of marketing strategies.
Requirements
- Proficient with big data frameworks and tools like Apache Hadoop, Apache Spark, or Apache Kafka for processing and analyzing large datasets.
- Hands on experience with data serialization formats like JSON, Parquet and XML.
- Consistently models and leads in best practices and optimization for scripting skills in languages eg. Python/ Java/ Scala, etc for automation and data processing.
- Proficient with database administration and performance tuning for databases like MySQL, PostgresSQL or NoSQL databases.
- Proficient with containerization (e.g., Docker) and orchestration platforms (e.g., Kubernetes) for managing data applications.
- Proven cloud experience and strong familiarity with at least one cloud platform (Microsoft Azure - preferred, AWS).
- Experience in building distributed data processing micro-services and high-quality, scalable data products.
Responsibilities
- Design, construct, install and maintain data architectures, including database and large-scale processing systems.
- Develop and maintain ETL (Extract, Transform, Load) processes to collect, cleanse and transform data from various sources inclusive of cloud.
- Design and implement data pipelines to collect, process and transfer data from various sources to storage systems (data warehouses, data lakes, etc).
- Implement data protection using encryption, secure key management, and access controls to ensure compliance with data privacy regulations.
- Build data solutions that ensure data quality, integrity and security through data validation, monitoring, and compliance with data governance policies.
- Administer and optimize databases for performance and scalability.
- Automate performance monitoring by capturing execution time, memory usage, and cost metrics, and surface insights through a real-time dashboard.
Other
- This role is based remotely but if you live within a 50-mile radius of an office [Atlanta, Austin, Detroit, Warren, or Mountain View], you are expected to report to that location three times a week, at minimum.
- Bachelor's degree (or equivalent work experience) in Computer Science, Data Science, Software Engineering, or a related field.
- Ability to work effectively in cross-functional teams, collaborate with data scientists, analysts, and stakeholders to deliver data solutions.
- Ability to lead and mentor junior data engineers, providing guidance and support in complex data engineering projects.
- Influential communication skills to effectively convey technical concepts to non-technical stakeholders and document data engineering processes.
