Big Data Engineer
Islamabad, Federal Teritory
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build ETL data ingestion pipelines
- Design batch data pipelines
- Design real-time streaming pipelines
- Develop Hive and Impala queries
- Develop distributed data processing systems
- Document data processes and workflows
- Ensure data governance security and data quality
- Implement Kafka streaming pipelines
- Ingest, transform, and integrate data
- Manage HDFS storage
- Monitor and troubleshoot data workflows
- Optimize pipeline performance and scalability
- Orchestrate ETL workflows
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Hadoop | Apache Hive | Apache Impala | Apache Kafka | Apache NiFi | Apache Spark | Azure | CI/CD | Cloud platform | Data Governance | Data Modeling | Data Quality | Data Security | Data Warehousing | Distributed Computing | Docker | ETL | Event Driven | Event-driven architecture | Google Cloud | Google Cloud Platform | HDFS | Java | Kubernetes | Parallel processing | PySpark | Python | Real Time | Real-time analytics | SQL | Scala
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI/ML | Agile delivery | Architecture | Audit Readiness | AutomationSenior-level Full TimeKarachi, Lahore, Islamabad1d ago
-
Senior Data Engineer INR 1500K-2750KAWS Glue | AWS IAM | AWS Lambda | Agile | Amazon EMRHybrid work schedule | Remote collaboration | UAE working hours complianceSenior-level Full TimeIslamabad, Capital3d ago
-
Senior Data Engineer INR 1500K-2750KAWS Glue | AWS IAM | AWS Lambda | AWS Step Functions | Agile ScrumHybrid work | UAE business hour collaborationSenior-level Full TimeLahore, Punjab3d ago
-
Senior Data Engineer INR 1500K-2750KAWS Glue | AWS IAM | AWS Lambda | AWS Step Functions | AgileHybrid work schedule | UAE business hours collaboration | UAE public holiday complianceSenior-level Full TimeKarachi, Sindh3d ago
-
Artificial Intelligence | Automated testing | CI/CD | Cloud Computing | Code reviewSenior-level Full TimeLahore R4d ago
-
Senior-level Full TimePK - ISLAMABAD 101 W AL …5d ago
-
Senior-level Full TimePK - ISLAMABAD 101 W AL …5d ago
-
Senior Database Engineer USD 110K-130KAWS RDS | Access Control | Azure SQL | Backup and Recovery | Cloud SQLSenior-level Full TimeLahore, Pakistan5d ago
-
Access Control | Agile | Azure Data | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeKarachi, Pakistan5d ago
-
Mid-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan7d ago
-
Mid-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan7d ago
-
AI Engineer II USD 140K-195KAPI Integration | AWS | CI/CD | Databricks | DockerHealthcare benefits | Hybrid workMid-level Full TimeLahore, Punjab, Pakistan7d ago
-
Expert Operations Technology and Analytics USD 141K-202KAI | API Integration | Analytics | Avaya | Conversational AIContinuous learning and development | Cross-functional collaboration | Inclusive work environment | Professional cultureSenior-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan8d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeKarachi, Pakistan11d ago
-
AWS | Azure | Batch Processing | Cloudera | Data ArchitectureSenior-level Full TimeKarachi, PK, 7400011d ago
-
API Development | AWS | Anthropic API | Chroma | EmbeddingsCareer growth | Holiday pay | Medical insurance | Paid time offSenior-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan12d ago
-
Domain AI/ML Engineer USD 141K-214KAWS | Agentic Workflows | Cloud platform | Generative AI | Google CloudSenior-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan13d ago
-
Senior Machine Learning Engineer INR 4250K-5500KARIMA | AWS SageMaker | Anomaly Detection | Azure ML | BacktestingSenior-level Full TimeLahore, Punjab, Pakistan13d ago
-
Senior-level Full TimeIslamabad, Lahore, Karachi13d ago
-
Data Engineer (Data Bricks) USD 132K-170KAWS Glue | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache KafkaSenior-level Full TimeIslamabad, Islamabad13d ago
-
AI / ML Engineer (Applied AI & Automations) CAD 90K-110KAPI Development | AWS | Azure | CI/CD | Cloud Computing401k plan | Company offsites | Equipment budget | Generous PTO | Medical/Dental/Vision insuranceMid-level Full TimeKarachi, Sindh, Pakistan13d ago
-
AI Engineer USD 101K-159KAPI Integration | Amazon Lex | CCaaS | Context handling | DialogflowCareer growth opportunities | Employee Wellness Initiatives | Learning and development programs | Life insurance | Medical coverageMid-level Full TimeLahore, Pakistan14d ago
-
API Integration | Automation workflows | CRM Integration | JavaScript | MakeHybrid workMid-level Full TimeLahore, Pakistan15d ago
-
Database Engineer ZAR 382K-442KAWS RDS | Azure SQL | Backup/Restore | Data Modeling | Database BackupBi-annual increment | Car support program | Career growth | EOBI | Health insuranceMid-level Full TimeKarachi, Sindh, Pakistan18d ago
-
Senior Consultants - AI Engineers - Financial Accounting & Advisory Services - Pakistan USD 125K-192KAKS | ARM Templates | Application Insights | Async Processing | Azure ContainerCoaching and Mentorship | Continuous learning | Flexible work arrangements | Inclusive collaborative cultureSenior-level Full TimeKarachi, PK, 7400019d ago