IT Data Engineering Middle
Tasks
- Deploy solutions to production
- Design data integration solutions
- Develop ETL/ELT pipelines
- Ensure data quality checks
- Estimate project effort for requirements
- Implement data analytics integration
- Implement data governance standards
- Manage code versioning and releases
- Monitor deployments in production
- Perform post production support for data incidents
- Process large volumes of data
- Schedule and orchestrate data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Databricks | Cloud platform | Data Factory | Data Governance | Data Lakehouse | Data orchestration | Databricks Workflows | Delta Lake | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Python | SQL
Education
N/A
Roles
Related jobs
-
Lead Data Engineer USD 172K-261KBig Data | Continuous Delivery | Data Architecture | Data Engineering | Data GovernanceAutonomy | Learning and development programs | Professional development programsSenior-level Full TimeLima, Peru16h ago
-
Lead Data Engineering USD 80K-120KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud StorageSenior-level Full TimePeru11d ago
-
AWS EMR | Airflow | Azure HDInsight | Cassandra | Cloud DataprocEducation Discounts | Research project opportunities | Training opportunitiesMid-level Full TimeBarranco, Peru30d ago