Data Engineer
Tasks
- Build end-to-end data pipelines
- Build real time and batch ingestion pipelines
- Design data engineering solutions
- Develop data storage computation frameworks
- Drive design discussions
- Implement data analytics search and aggregation
- Implement data ingestion integration transformation
- Implement infrastructure and cloud components
- Optimize pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
ActiveMQ | Airflow | Amazon Redshift | Azure SQL | Azure SQL Data | Azure SQL Data Warehouse | CI/CD | Cassandra | Cloud Computing | Data Catalog | Data Governance | Data Lineage | Data Warehouse | ETL | Flink | Google BigQuery | HBase | HDFS | Hadoop | Hive | Indexing | Java | Kafka | Microservices | MongoDB | Nifi | NoSQL | Oozie | Pulsar | Python | RabbitMQ | SQL | SQL Data Warehouse | Scala | Search | Solace | Spark | Spark Streaming | Sqoop | Storm
Education
N/A
Roles
Related jobs
-
Software Engineer INR 1400K-2000KAgile | Cloud services | Code review | Data Modeling | Database DesignMid-level Full TimePune, India12h ago
-
Amazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Cloud platformContract employment | Hybrid work | VIRTUAL interviewSenior-level ContractBangalore North, India14h ago
-
Data Engineer INR 1500K-2040KAgentic AI | Cost Optimization | Data Architecture | Data Modeling | Data platformSenior-level Full TimeIN-MH-Pune15h ago
-
Data Engineer Architect. INR 1500K-2400KAPI Development | AWS | Agentic Engineering | Database optimization | FastAPISenior-level Full TimeIN-MH-Pune15h ago
-
AIML - Tech Lead INR 2500K-4500KApache Airflow | ETL | Entity recognition | Language Processing | Machine LearningSenior-level Full TimeIN-MH-Pune15h ago
-
Senior GenAI Developer INR 2500K-4800KAPI Gateway | AWS Bedrock | Agent systems | Agentic RAG | Amazon LambdaCertification programs | Global client projects | Health insurance | Internship opportunities | Language coursesSenior-level Full TimeAll Cities, India R16h ago
-
Senior-level Full TimePune, Maharashtra, India17h ago
-
Software Engineer II - Gen AI/ Agentic AI INR 1500K-2500KAWS | Amazon Elastic Kubernetes Service | Amazon SageMaker | Data Processing | Data integrationMid-level Full TimeHyderabad, Telangana, India18h ago
-
Senior-level Full TimeBengaluru, Karnataka, India19h ago
-
Senior Lead Software Engineer - Java, PySpark, and AWS INR 1800K-2400KAWS | AWS Glue | AWS Lake Formation | AWS Lambda | AWS Step FunctionsSenior-level Full TimeHyderabad, Telangana, India19h ago
-
AWS | Agile | Amazon Web Services | Apache Airflow | Application ResiliencySenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Group Lead - Data Quality Engineer INR 1500K-2500KADLS Gen2 | Anomaly Detection | Apache Spark | Automated alerting | CI/CDSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Senior Software Engineer (Data Engineering, Python, SQL, Snowflake, Cloud and Devops) INR 2500K-3380KAWS | AWS Step Functions | Airbyte | Airflow | Apache HudiCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningSenior-level Full TimeChennai, TN, India20h ago
-
GenAI & Python Developer INR 1800K-3000KAPI Development | Agile | Data Pipelines | Data Preprocessing | Dataset cleaningAgile team collaborationMid-level Full TimeNoida, Uttar Pradesh, India20h ago
-
AWS | Agile | Application Resiliency | CI/CD | DatabricksMid-level Full TimeHyderabad, Telangana, India20h ago
-
Associate Principal Engineer, Data Science INR 1500K-2000KANOVA | CI/CD | Cloud Architecture | Deep learning | GCPMid-level Full TimeRemote, India R20h ago
-
Associate Principal Engineer, Data Science INR 1500K-2000KANOVA | AWS | Azure | CI/CD | Cloud ArchitectureMid-level Full TimeRemote, India R21h ago
-
Azure Data & Fabric Developer / ETL pipeline & SQL ( 5 + yrs Assistant Manager - RNA INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, MH, India21h ago
-
Data Science and Gen AI Developer-Associate INR 900K-2000KAutogen | CI/CD | Data Analysis | Data Visualization | ETLMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Lead Software Engineer INR 1800K-2400KAWS | AWS Glue | AWS Identity | AWS Identity and Access Management | AWS Key Management ServiceSenior-level Full TimeMumbai, Maharashtra, India21h ago
-
Business Intelligence Engineer - Power BI INR 712K-1200KAgile | DAX | Data Modeling | Data Quality | Data WarehousingFlexible hybrid schedule | Health insurance | Life insurance | Paid time off | Personal/family care leaveMid-level Full TimeHyderabad, India R22h ago
-
Assistant Manager - SA2 (AI Hub - GDC) INR 1400K-2200KAWS | Agent Development | Apache Kafka | Autogen | AzureMid-level Full TimeHyderabad, Telangana, India22h ago
-
AWS | Agile | Amazon Web Services | Apache Airflow | CI/CDSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Sr Data Engineer I INR 3000K-4000KAWS | Automation | Big Data | Cloud Computing | Data ArchitectureSenior-level Full TimeHyderabad, Telangana, India22h ago
-
Senior Data Engineer INR 2800K-4000KAWS Elastic MapReduce | Agile | Apache Spark | Business Intelligence | Data WarehousingAnnual health check eye checkup dental screening OPD reimbursement | Employee assistance program | Free transportation | Leave policy | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India22h ago