Data Engineer - AWS, PySpark
Bengaluru, Maruthi Onyx - TESCO TSA, India
INR 1400K-1500K (estimate) Entry-level Full Time
Tasks
- Build and maintain data pipelines
- Build reusable components for Snowflake and AWS
- Build scalable data transformation solutions
- Design and implement data lakes
- Design and implement data warehouses
- Develop ELT pipelines
- Develop data processing and analysis algorithms
- Develop machine learning model pipelines
- Implement cloud data movement strategy
- Implement data ingestion to Snowflake
- Orchestrate data workflows
- Provide data governance and lineage
- Translate requirements into ETL components
- Write advanced SQL and PL SQL
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS Lake Formation | AWS Lambda | Alation | Amazon Athena | Amazon S3 | Apache Airflow | Apache Spark | CSV | DBT | Data Governance | Data Ingestion | Data Lakes | Data Lineage | Data Transformation | Data Warehousing | DataFrame | ELT | Iceberg | Immuta | JSON | Lake Formation | NoSQL | PL/SQL | Parquet | PySpark | RDD | SQL | Snowflake | Snowflake Tasks | Spark SQL
Education
N/A
Roles
Related jobs
-
Data Science AI Engineer, Senior Professional INR 2500K-4500KAPI Development | AWS | Agentic AI | Apache Spark | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R1d ago
-
Manufacturing Data Analytics Technical Expert INR 1628K-2146KApache Hive | Apache Spark | Data Historian | Data analytics | Data integrationSenior-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Mid-level Full TimeIndia2d ago
-
Lead Assistant Manager INR 500K-1500KAWS | Apache Airflow | Cloud platform | Data Governance | Data LakehouseSenior-level Full TimeIndia2d ago
-
Senior Data Engineer INR 1300K-2000KAPI Integration | API Security | Agile | Apigee | Asset ManagementSenior-level Full TimeChennai, Tamil Nadu, India2d ago
-
Senior Consultant INR 1800K-2200KAmazon Aurora | Amazon Aurora PostgreSQL | Amazon Relational Database Service | Amazon Web Services | Aurora PostgreSQLSenior-level Full TimeIN-AP-Hyderabad2d ago
-
Associate, Data Analytics & AI INR 1000K-1800KAmazon SageMaker | Anthropic API | Azure Machine Learning | CRM | CrewAIWellness Fridays | Wellness resources | Work-life balance supportMid-level Full TimePune, Maharashtra, India R2d ago
-
Senior-level Full TimeIN-AP-Hyderabad2d ago
-
Data Analytics-Python Developer INR 2000K-3000KAgile | Dagster | Data Modeling | Dimensional Modeling | DockerMid-level Full TimeBengaluru, Karnataka, India2d ago
-
Senior AI Engineer INR 2000K-3800KAWS | Agent Orchestration | Amazon Bedrock | Artificial Intelligence | Confidence scoringComprehensive health benefits | Flexible work environment | Generous time off | Global days of service | Hybrid work modelSenior-level Full TimeBengaluru, Karnataka, India2d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud StorageMid-level Full TimeBangalore, Karnataka, India2d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KBatch Processing | BigQuery | Dataflow | Dataproc | ETLMid-level Full TimeBangalore, Karnataka, India2d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KApache Hadoop | Apache Hive | Apache Spark | Batch Processing | Cloud DataflowMid-level Full TimeBangalore, Karnataka, India2d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud StorageMid-level Full TimeBangalore, Karnataka, India2d ago
-
Technical Program Manager, AI Agent Prototyping INR 1875K-3000KA/B | A/B Testing | B testing | Cloud Computing | Data QualityMid-level Full TimeBengaluru, Karnataka, India2d ago
-
GCP and Databricks Assistant Manager Hiring INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud FunctionsMid-level Full TimeBangalore, Karnataka, India2d ago
-
Manager - Fraud Analytics & Monitoring (Detection) INR 618K-618KAnomaly Detection | Artificial Intelligence | Behavioral analytics | Decisioning systems | Early WarningAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive and diverse team cultureMid-level Full TimeMumbai, India2d ago
-
Finance - Analytics Finance - Associate INR 1960K-2461KCRM | Data Governance | Data Pipelines | Data Quality | Data StewardshipSenior-level Full TimeBengaluru2d ago
-
DE&A - Core - Big Data Engineering - ETL INR 2040K-2400KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud ArchitectureSenior-level Full TimeBangalore, Karnataka, India2d ago
-
Agentic / GEN AI INR 2500K-4000KAI Foundry | AI Services | Agentic AI | Azure AI | Azure AI ServicesSenior-level Full TimeNoida, Uttar Pradesh, India2d ago
-
AI Engineer INR 2000K-2600KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | Agent Development KitMid-level Full TimePune, Maharashtra, India2d ago
-
Mid-level Full TimeHyderabad, India2d ago
-
Manager Data Reliability Engineering INR 1500K-2000KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeHyderabad2d ago
-
Lead, AI Engineer INR 2000K-4500KAI Assistants | API Integration | AWS | AWS Bedrock | AWS CDKBenefits | Bonus eligibility | Competitive pay | Equity | Hybrid work environmentSenior-level Full TimeAhmedabad, Gujarat2d ago
-
Sr. Data Engineer INR 3200K-4500KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeBengaluru, India2d ago