Job Description

Responsibilities*
Develop production-quality ETL workflows & data pipelines running in a distributed, containerized, cloud-native environment to support ingestion, transformation, & dissemination of complex social science research data & metadata from a variety of data sources.
Develop tools & software to process archival & statistical file formats including SPSS, SAS, Stata, & R.
Use AWS Cloud products to design & manage relational & non-relational data storage services.
Write SQL queries for creating & developing data reports that cater to the needs of the consumers of ICPSR datasets.
Apply best practices in software development & data management to improve curation workflows in a secure data environment by building a library of reusable scripts & tools orchestrated by an automated jobs framework.
Develop secure, scalable, & resilient REST APIs in Python to expose data as a service to upstream producers & downstream consumers.
Implement monitoring solutions for data engineering products & provide operational support to pipelines & APIs in production.
Research & identify open source & COTS (commercial off the shelf) tools to solve challenging problems while minimizing the need for custom code.
Required Qualifications*
Position requires a Bachelor's degree in Computer Science or Software Engineering or Computer Engineering or Information Systems
60 months experience as a Data Engineer &/or Extract, Transform, & Load (ETL) Developer &/or Data Warehouse Engineer &/or Big Data Developer.
Position also requires: Exp. must include:

60 mos. exp. programming in Python for data engineering projects;
60 mos. exp. using SQL to query & modify relational database management systems;
60 mos. exp. building production-quality data pipelines using ETL &/or data integration &/or data orchestration tools & frameworks;
60 mos. exp. building interfaces with heterogeneous data sources & sinks including REST (representational state transfer) APIs (application programming interfaces); &
60 mos. exp. using AWS Cloud storage & computing.