Analyst, Big Data Analytics & Engineering
Tasks
- Build ETL pipelines
- Collaborate with data scientists
- Contribute to data workflow CI CD
- Design governed data models
- Develop Spark data processing jobs
- Implement data quality checks
- Optimize pipeline performance and cost
- Publish analysis ready datasets
- Support data governance and security
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Apache Airflow | Apache Hadoop | Apache Hadoop ecosystem | Apache Hudi | Apache Iceberg | Apache NiFi | Apache ORC | Apache Parquet | Apache Spark | Auditability | Azure | Azure Data | Azure Data Factory | Broadcast Join | Bucketing | CDC | CI/CD | Cloud platform | Data Factory | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Quality | Delta Lake | ELT | ETL | Git | Google Cloud | Google Cloud Platform | HDFS | Hadoop | Hadoop Ecosystem | Hive | Impala | Incremental processing | Observability | Oozie | PII handling | Partitioning | PySpark | Python | SCD Type 1 | SCD Type-2 | SQL | Shuffle Optimization | Talend | Testing | Type 1 | Type 2) | YARN
Education
Roles
Related jobs
-
Senior Analyst, Analytics Engineer INR 2771K-4000KApplication Monitoring | DBT | Data Compliance | Data Governance | Data ModelingRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN3h ago
-
IT Solution database engineer INR 1500K-2700KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure SQLSenior-level Full TimeBengaluru, KA, India4h ago
-
AI Engineer INR 450K-700KData Preprocessing | Deep learning | Language Processing | MLOps | Machine LearningCareer development | Hybrid work flexibilityExecutive-level Full TimeNoida, India R4h ago
-
Senior Software Engineer, Data Platform INR 2000K-4200KApache Pinot | Artifactory | Git | Go | JavaSenior-level Full TimeIndia (Remote) R6h ago
-
Python, Pyspark Developer INR 2800K-4000KAgile | AngularJS | Ansible | Big Data | BootstrapDevelopment courses | Digital wellbeing platform | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimeChennai, IN6h ago
-
Mid-level Full TimeIN-Pune6h ago
-
API | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringAdvanced AI exposure | Collaborative environment | Continuous learning | Contract engagement | End-to-end ownershipSenior-level Contract Full TimeIndia R7h ago
-
AI Agent Builder | AI platforms | Agent Builder | Agent Orchestration | ApexContinuous learning | Follow the sun collaboration | Healthcare mission impact | Inclusive culture | Professional developmentSenior-level Full TimeIndia8h ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R10h ago
-
Senior Agentic Engineer, AI Platform INR 3000K-5000KAPI Development | AWS | Agent Orchestration | Authentication | AutoscalingSenior-level Full TimeBengaluru R10h ago
-
Mid-level Full TimeKochi, India11h ago
-
SW Engineer (1 - 2 years of exp in .Net / Python, Full-stack development, Angular / React, GenAI) INR 1500K-2500K.NET | API Management | Agile | Angular | Azure DevOpsHybrid work schedule | Limited direction working environmentMid-level Full TimeBengaluru, India R11h ago
-
Mid-level Full TimeHyderabad, TG, IN11h ago
-
DBT/Snowflake Engineer INR 1000K-2000KAzure DevOps | CI/CD | DBT | Data Modeling | Data WarehousingMid-level Full TimeHyderabad, TG, IN11h ago
-
DBT/Snowflake Engineer INR 1000K-2000KCI/CD | DBT | Data Modeling | Data Warehousing | Dimensional ModelingMid-level Full TimeHyderabad, TG, IN11h ago
-
Senior Data Engineer INR 3600K-5000KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFinancial wellness support | Flexible remote work on Fridays | Hybrid work schedule | Mental health support | Paid time offSenior-level Full TimeBengaluru, India R15h ago
-
Senior Software Engineer, MLOps/SRE INR 2475K-3500KAerospike | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD401k pension | Disability insurance | Financial wellness support | Healthcare benefits | Life insuranceSenior-level Full TimeBengaluru, India R15h ago
-
Associate Principal Engineer, AI Architect INR 1800K-3300KAPI Integration | AWS | Agent Orchestration | Azure | Backend architectureMid-level Full TimeRemote, India R18h ago
-
Associate Principal Engineer, AI Architect INR 1800K-3300KAPI Integration | AWS | Agent Orchestration | Azure | Backend DevelopmentMid-level Full TimeGurugram, India18h ago
-
Associate Principal Engineer, AI Architect INR 1800K-3300KAPIs | AWS | Agent Orchestration | Azure | Backend DevelopmentMid-level Full TimeHyderabad, India19h ago
-
Principal Engineer, AI Architect INR 2000K-5000KAWS | Agent Orchestration | Azure | Backend architecture | Claude CodeSenior-level Full TimeGurugram, India19h ago
-
Principal Engineer, AI Architect INR 2000K-5000KAWS | Agent Orchestration | Azure | Backend architecture | Cloud ComputingSenior-level Full TimeRemote, India R19h ago
-
Principal Engineer, Python fullstack (React+Genai) INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ComplianceSenior-level Full TimeRemote, India R19h ago
-
Founding AI Data Engineer - Optexity (India) INR 900K-1300KData Engineering | Data pipeline | Language Models | Language Processing | Large Language ModelsDirect founder access | Equity | Full compute and dataEntry-level Full TimeBangalore19h ago
-
Entry-level Full TimeHyderabad, India20h ago