Data Engineer - AWS, PySpark
Bengaluru, Maruthi Onyx - TESCO TSA, India
INR 1400K-1500K (estimate) Entry-level Full Time
Tasks
- Build and maintain data pipelines
- Build reusable components for Snowflake and AWS
- Build scalable data transformation solutions
- Design and implement data lakes
- Design and implement data warehouses
- Develop ELT pipelines
- Develop data processing and analysis algorithms
- Develop machine learning model pipelines
- Implement cloud data movement strategy
- Implement data ingestion to Snowflake
- Orchestrate data workflows
- Provide data governance and lineage
- Translate requirements into ETL components
- Write advanced SQL and PL SQL
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS Lake Formation | AWS Lambda | Alation | Amazon Athena | Amazon S3 | Apache Airflow | Apache Spark | CSV | DBT | Data Governance | Data Ingestion | Data Lakes | Data Lineage | Data Transformation | Data Warehousing | DataFrame | ELT | Iceberg | Immuta | JSON | Lake Formation | NoSQL | PL/SQL | Parquet | PySpark | RDD | SQL | Snowflake | Snowflake Tasks | Spark SQL
Education
N/A
Roles
Related jobs
-
AWS | Agent systems | Agentic AI | Amazon SageMaker | Autonomous AgentsSenior-level Full TimeBengaluru Millenia, India6h ago
-
Azure Databricks | CI/CD | Data Pipelines | Data integration | ETLSenior-level Full TimeGurugram 10 C, India6h ago
-
Azure Databricks | Data integration | ETL | Filtering | JoiningSenior-level Full TimeGurugram 10 C, India6h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Azure | CI/CD | Data Augmentation | Data PreprocessingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India6h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | CI/CD | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India6h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | Azure | CI/CDFlexibility program | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India6h ago
-
Data Engineer INR 1200K-1496KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud BuildEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India12h ago
-
Staff Engineer - Java,Scala,AWS INR 3000K-4000KAWS S3 | Agile | Amazon ECS | Amazon EFS | Amazon EMRFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India16h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai17h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai17h ago
-
Senior-level Full TimeIN-TN-Chennai17h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad17h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad17h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIndia18h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India18h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India19h ago
-
Mid-level Full TimeMumbai, Maharashtra, India19h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India23h ago
-
Mid-level Full TimeBangalore, Karnataka, India23h ago
-
Senior-level Full TimeBangalore, Karnataka, India23h ago
-
Senior-level Full TimeHyderabad, India23h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600371d ago
-
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500KAWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CDSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Senior-level Full TimeGurgaon, Haryana, India1d ago