Senior Specialist, GSF DnA Data Engineer
IND - Telangana - Hyderabad (HITEC City) (Inactive), India
INR 2475K-3465K (estimate) Senior-level Full Time
Tasks
- Build AWS lakehouse and data warehouse solutions
- Build dimensional models for analytics
- Coach and mentor data engineers through reviews and pairing
- Create and maintain technical documentation
- Design batch and streaming data pipelines
- Develop Databricks transformations with PySpark and Spark SQL
- Implement data quality controls and data contracts
- Lead data engineering standards and technical mentorship
- Optimize SQL for performance and cost
- Package workloads with Docker
- Provision cloud resources with Terraform
- Set up data orchestration logging monitoring and alerting
- Use GitHub for version control and CI/CD
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Fargate | AWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Alerting | Amazon CloudWatch | Amazon ECS | Amazon EMR | Amazon Web Services | Apache Spark | CI/CD | Data Catalog | Data Contracts | Data Governance | Data Lineage | Data Observability | Data Quality | Databricks | Databricks Delta | Databricks Delta Lake | Delta Lake | Dimensional Modeling | Docker | GitHub | Infrastructure as Code | Integration Testing | Logging | Monitoring | Orchestration | Parquet | PySpark | Python | SCD Type-2 | SQL | Slowly Changing Dimensions | Snowflake Schema | Spark SQL | Star Schema | Step Functions | Terraform | Type 2) | Unit Testing | Web Services | “as-code”
Education
Roles
Related jobs
-
AI Engineer INR 2475K-4200KAgentic Systems | Azure OpenAI | Azure OpenAI APIs | Azure OpenAI SDK | Cloud IntegrationEntry-level Full TimeBengaluru, KA, IN7h ago
-
Data Engineer Advisor INR 3200K-4200KAlerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, TG, IN7h ago
-
AI/ML Expert INR 2500K-5000KAgent systems | Edge Computing | Embedded Systems | Entity Extraction | Fine TuningSenior-level Full Timepune, India7h ago
-
Associate Distinguished Engineer (Agentic AI Architect) INR 1500K-3000KAI Governance | AI architecture | AI orchestration | APIs | AWSMid-level Full TimeIndia, India8h ago
-
AWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | Computer VisionContinuous learning and development | Flexible schedule | Fully remote | Mentorship opportunitiesMid-level Full TimeIndia R8h ago
-
Data Scientist INR 3000K-4000K3D Perception | Active Learning | Computer Vision | Container Orchestration | Data AnnotationSenior-level Full TimeBengaluru, KA, India8h ago
-
Data and AI/ML Design engineer at NE-VM INR 2000K-3300KAgile | Apache Kafka | C# | CSS | Computer VisionSenior-level Full Timebangalore, India8h ago
-
Senior-level Full Timecoimbatore, India8h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2700KApache Kafka | Data Warehousing | Dimensional Modeling | Git | GitHubSenior-level Full TimeBangalore, India8h ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2500KAPIs | Alerting | Data Augmentation | Data Lineage | Data ModelingSenior-level Full Timebangalore, India8h ago
-
Senior-level Full Timebangalore, India8h ago
-
MLOps Engineer III INR 2500K-3465KAWS Bedrock | AWS SageMaker | CI/CD | Docker | KubernetesComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Software Engineer INR 2475K-3465KCI/CD | Data Modeling | Exception Handling | FastAPI | GitHubEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India9h ago
-
Senior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …14h ago
-
Data Modeler INR 2520K-4000KAWS | Access Control | Azure | Cloud Data | Cloud data platformFlexible work arrangementsMid-level Full TimeNoida / Gurgaon, DL, IN14h ago
-
Mid-level Full TimeBengaluru, KA, IN14h ago
-
Senior AI/Data Science Engineer INR 3520K-5400KA/B | A/B Testing | APIs | Agentic Workflows | Artificial IntelligenceFlexible benefits | Short-term incentive planSenior-level Full TimeIND-TS Hyderabad Nanakramguda, India14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
API Development | Agent Orchestration | Async Programming | Autogen | Best practicesSenior-level Full TimeNoida, India14h ago
-
SEI - Data Migration Engineer (IMS) (Expanded Resources) INR 2520K-3880KAirflow | Bulk Insert | CI/CD | Cx Oracle | DBT CoreSenior-level Full TimeBangalore, KA, IN14h ago
-
CT-NITRO-Experimental AI Engineer INR 3715K-5449KAutoEncoder | Autoencoders | Containerization | Deep learning | DockerSenior-level Full TimeBengaluru, KA, IN, 56004814h ago
-
Sr. Data Science Consultant - Machine Learning,Python INR 2520K-4500KAPI Integration | Apache Airflow | Dask | Data Visualization | Hypothesis TestingSenior-level Full TimeBangalore, India14h ago
-
Sr. Data Science Consultant - Machine Learning,Python INR 3000K-5000KAPI Integration | Apache Airflow | Applied statistics | Classifier | DaskClient onboarding support | Mentorship | Ongoing operational supportSenior-level Full TimeBangalore, India14h ago
-
Technical Solution Consultant INR 2400K-3380KCloud platform | Data Modeling | Data integration | ELT | ETLEntry-level Full TimeBangalore, KA, IN14h ago
-
Databricks Engineer INR 2040K-3000KCloud Data | Cloud Data Engineering | Data Engineering | Data Pipeline Development | Data ReconciliationSenior-level Full TimeBangalore, KA, IN14h ago