Data Engineer
A USD 125K-153K (estimate) Mid-level Full Time
Tasks
- Build scalable ETL/ELT pipelines
- Build streaming real time data pipelines
- Create CI/CD workflows
- Deliver curated datasets for analytics and machine learning workflows
- Deploy containerized data infrastructure
- Design and optimize cloud data warehouses
- Develop analytics-ready data models
- Develop data extraction transformation loading workflows
- Implement data validation anomaly detection and logging
- Maintain pipeline documentation and data definitions
- Manage cloud infrastructure using infrastructure as code
- Manage data governance and lineage tracking
- Monitor pipeline health and failed jobs
- Optimize SQL query performance
- Orchestrate and automate data pipelines
Perks/Benefits
Skills/Tech-stack
AWS CloudFormation | AWS Glue | Amazon Kinesis | Amazon Redshift | Anomaly Detection | Apache Airflow | Azure Data | Azure Data Factory | BigQuery | CI/CD | Clustering | DBT | Dagster | Data Factory | Data Lineage | Data Modeling | Data Validation | Data Warehousing | Docker | ELT | ETL | Event Driven | Event-driven architecture | GCP Dataflow | GitHub Actions | GitLab CI | Google Pubsub | Great Expectations | Jenkins | Kafka | Kubernetes | Logging | Looker | Luigi | Partitioning | Power BI | Prefect | Python | Real Time | Real-time Processing | SQL | Snowflake | Snowflake Schema | Star Schema | Streaming Data | Tableau | Terraform | Time processing
Education
N/A
Roles
Related jobs
-
Artificial Intelligence | Automated testing | CI/CD | Cloud Computing | Code reviewSenior-level Full TimeLahore R5d ago
-
Part-Time AI Engineers USD 130K-180KArtificial Intelligence | Debugging | Python | ReactFlexible hours | Part-time employment | Remote collaborationMid-level Part TimePakistan - Remote R30d ago
-
AWS CloudFormation | Amazon Kinesis | Apache Airflow | BigQuery | CI/CDFully remote | Growth opportunities | U.S. business hoursMid-level Full TimePakistan - Remote R1mo ago
-
AWS | Airflow | Azure | CI/CD | DagsterFlexible US business hours | Remote workMid-level Full TimePakistan - Remote R1mo ago
-
AI/ML Engineer CAD 105K-115KAPI Integration | Automation | JavaScript | LLM integration | Language ModelsCareer growth | Flexible schedule | Remote workMid-level Full TimeIslamabad, Pakistan R1mo ago
-
DevOps Engineer USD 100K-141KAWS CloudFormation | Amazon Web Services | Ansible | Azure | BashFlexible working hours | Health insurance | Life insurance | Paid certifications | Paid time offMid-level Full TimeLahore, Punjab, Pakistan - Remote R1mo ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Data FactoryRemote workSenior-level Full TimeLahore, Pakistan R1mo ago
-
Backend AI & Data Pipeline Engineer USD 90K-120KAWS EventBridge | AWS Lambda | AWS Step Functions | Amazon Bedrock | Amazon ECSFlexible working hours | Fully remote | Professional growthEntry-level Full Time InternshipIslamabad, Islamabad Capital Territory, Pakistan R1mo ago