Big Data Developer
Tasks
- Build big data processing systems
- Design scalable data pipelines
- Document data architecture and workflows
- Ensure data quality, integrity, and security
- Implement ELT processes
- Implement ETL processes
- Integrate cloud and on premise data systems
- Monitor and troubleshoot data pipelines
- Optimize data architectures using AWS
- Process and analyze large datasets
- Tune PostgreSQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Amazon S3 | Amazon Web Services | Apache Spark | Data Pipeline Monitoring | Data Warehousing | Data pipeline | Distributed Systems | ELT | ETL | Pipeline monitoring | PostgreSQL | Web Services
Education
N/A
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
WFS Analytics 168375 INR 1600K-2500KAgile methodology | Architectural patterns | Design Patterns | Distributed Systems | JavaMid-level Full TimeHyderabad, IND-TG, India1h ago
-
Mid-level Full TimeHyderabad, IND-TG, India1h ago
-
Amazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Cloud platformContract employment | Hybrid work | VIRTUAL interviewSenior-level ContractBangalore North, India5h ago
-
Data Engineer INR 1500K-2040KAgentic AI | Cost Optimization | Data Architecture | Data Modeling | Data platformSenior-level Full TimeIN-MH-Pune6h ago
-
AIML - Tech Lead INR 2500K-4500KApache Airflow | ETL | Entity recognition | Language Processing | Machine LearningSenior-level Full TimeIN-MH-Pune6h ago
-
Senior GenAI Developer INR 2500K-4800KAPI Gateway | AWS Bedrock | Agent systems | Agentic RAG | Amazon LambdaCertification programs | Global client projects | Health insurance | Internship opportunities | Language coursesSenior-level Full TimeAll Cities, India R7h ago
-
Lead Software Engineer, ML Engineering INR 2000K-3500K.Net Core | ASP.NET | C# | CSS | Data ModelingSenior-level Full TimePune, Maharashtra, India7h ago
-
DE&A - Power BI - Senior Developer INR 3000K-4000KAgile | Analytical Functions | Azure Data | Azure Data Factory | BI DesktopSenior-level Full TimePune, Maharashtra, India8h ago
-
Senior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Lead Software Engineer - Java, PySpark, and AWS INR 1800K-2400KAWS | AWS Glue | AWS Lake Formation | AWS Lambda | AWS Step FunctionsSenior-level Full TimeHyderabad, Telangana, India10h ago
-
AWS | Agile | Amazon Web Services | Apache Airflow | Application ResiliencySenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Group Lead - Data Quality Engineer INR 1500K-2500KADLS Gen2 | Anomaly Detection | Apache Spark | Automated alerting | CI/CDSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior Software Engineer (Data Engineering, Python, SQL, Snowflake, Cloud and Devops) INR 2500K-3380KAWS | AWS Step Functions | Airbyte | Airflow | Apache HudiCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningSenior-level Full TimeChennai, TN, India11h ago
-
Azure Data & Fabric Developer / ETL pipeline & SQL ( 5 + yrs Assistant Manager - RNA INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, MH, India11h ago
-
Data Science and Gen AI Developer-Associate INR 900K-2000KAutogen | CI/CD | Data Analysis | Data Visualization | ETLMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Lead Software Engineer INR 1800K-2400KAWS | AWS Glue | AWS Identity | AWS Identity and Access Management | AWS Key Management ServiceSenior-level Full TimeMumbai, Maharashtra, India12h ago
-
Business Intelligence Engineer - Power BI INR 712K-1200KAgile | DAX | Data Modeling | Data Quality | Data WarehousingFlexible hybrid schedule | Health insurance | Life insurance | Paid time off | Personal/family care leaveMid-level Full TimeHyderabad, India R12h ago
-
Assistant Manager - SA2 (AI Hub - GDC) INR 1400K-2200KAWS | Agent Development | Apache Kafka | Autogen | AzureMid-level Full TimeHyderabad, Telangana, India12h ago
-
Manager INR 1500K-2040KApache Spark | CI/CD | Data Modeling | Data Quality | DatabricksIn office work schedule 5 daysSenior-level Full TimeIndia12h ago
-
AWS | Agile | Amazon Web Services | Apache Airflow | CI/CDSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Sr Data Engineer I INR 3000K-4000KAWS | Automation | Big Data | Cloud Computing | Data ArchitectureSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Senior Data Engineer INR 2800K-4000KAWS Elastic MapReduce | Agile | Apache Spark | Business Intelligence | Data WarehousingAnnual health check eye checkup dental screening OPD reimbursement | Employee assistance program | Free transportation | Leave policy | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Oracle Analytics-Reporting INR 800K-1500KAnalytics Cloud | Business Intelligence Publisher | Data Warehousing | Dimension tables | ESS JOBSMid-level Full TimeBangalore, Karnataka, India13h ago
-
Lead Software Engineer INR 3150K-4500KAWS EMR | AWS SNS | AWS SQS | Amazon Web Services | CI/CDCareer development opportunities | Comprehensive benefits | Flexible working arrangements | Work-life balanceSenior-level Full TimeMumbai, India14h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 2500K-3630KAWS | Apache Spark | Azure | Computer Vision | Convolutional Neural NetworksSenior-level Full Timebengaluru, India15h ago