Technical Lead-Data Engg
INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN
INR 1500K-2040K (estimate) Senior-level Full Time
Tasks
- Apply data masking and row level security
- Build multi source ingestion frameworks
- Build reusable DBT macros
- Create incremental and snapshot models
- Design Snowflake enterprise data platforms
- Develop SQL and DBT validation tests
- Develop dbt transformation layers
- Develop schema conversion and transformation mappings
- Implement Snowpipe ingestion
- Implement StreamSets ingestion pipelines
- Implement Streams and Tasks for CDC
- Implement incremental and parallel run migration validation
- Implement time travel and zero copy cloning
- Optimize storage and query performance
- Orchestrate pipelines with Apache Airflow
- Perform source profiling and data quality remediation
- Plan and execute data migration to Snowflake
- Support cutover planning and production readiness
Perks/Benefits
- N/A
Skills/Tech-stack
API | AWS | Apache Airflow | Avro | Azure | CDC | Cloud platform | DBT | Data Ingestion | Data Migration | Data Quality | Data masking | Data profiling | ELT | ETL | Google Cloud | Google Cloud Platform | Incremental processing | JSON | Micro partition pruning | Micro-Partition | Microsoft SQL | Microsoft SQL Server | Netezza | Oracle | Parallel Run | Parallel Run Validation | Partition Pruning | PostgreSQL | RBAC | Row Level Security | SAP | SQL | SQL Server | Schema conversion | Snowflake | Snowpipe | Streams and Tasks | Streamsets | Surrogate Key | Teradata | Time Travel | XML | Zero copy | Zero-Copy Cloning
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
AI Data Engineer III INR 3000K-3880KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Business Analytics Lead (8+ Years) INR 2516K-4000KDashboarding | Data Modeling | ETL | Python | Qlik SenseAccidental insurance | Adoption assistance program | Car lease | Critical illness insurance | Day-care Support ProgramSenior-level Full TimeBangalore4h ago
-
ETL Migration Engineer - Data Integration - Lead Consultant INR 1650K-2600KAPI | AWS | AWS Glue | Amazon EKS | Apache AirflowSenior-level Full TimeChennai, IN, 6000325h ago
-
ETL QA - Consultant INR 850K-1500KAgile | Case design | Data Mapping | Data Migration | Data QualityMid-level Full TimePune, IN, 4110575h ago
-
Data Engineer INR 3000K-3500KAlerting | Amazon Redshift | Apache Spark | Argo Workflows | AzureAgile working options | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon5h ago
-
IT Analyst INR 950K-1250KAzure | Azure ML | Azure OpenAI | Cognitive Services | EmbeddingsContinuing education program | Continuous learning | Family-friendly perks | Flexible time off | Health care coverageMid-level Full TimeIN - NOIDA CANDOR TECHSPACE SECTOR …10h ago
-
Senior Data Engineer INR 3000K-4000KAzure Databricks | Data Governance | Data Modeling | Data Monitoring | Data QualitySenior-level Full TimeHyderabad, TG, IN10h ago
-
IN_Manager_Data Engineer_D&A_Advisory_Mumbai INR 3000K-4000KAlerting | Azure | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeMumbai Shivaji Park, India10h ago
-
Information Security Automation Engineer INR 1000K-1500KAI Programming | API | AWS | Agile | AuditabilityMid-level Full TimeGurgaon, HR, IN, 12200210h ago
-
Cloud Computing | Computer Vision | Data Pipelines | Data Quality | Data Quality EvaluationAccidental insurance | Hybrid work options | Life insurance | Medical insurance | Paid parental leaveSenior-level Full TimeBangalore, India (Hybrid) R16h ago
-
Staff Engineer – Data/AI Platform Engineering INR 3000K-5000KAzure | Batch Processing | Data Catalog | Data Governance | Data IngestionAccidental insurance | Flexible hours | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R17h ago
-
Cloud Platforms | Computer Vision | Data Quality | Fine Tuning | Language ModelsAccidental insurance | Flexible hours | Hybrid work options | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R17h ago
-
API | AWS | Airflow | CSV | CronFlexible work arrangements | Health and wellness benefits | Hybrid work arrangement | Inclusive work culture | Learning and development opportunitiesMid-level Full TimeIndia20h ago
-
Consultant - Data Warehouse -238 INR 2520K-4000KBusiness Intelligence | Cloud Platforms | Data Governance | Data Modeling | Data VisualizationEmployee engagement initiatives | Training and mentorshipMid-level Full TimeBengaluru, Karnataka21h ago
-
Senior-level Full TimeIN-KA-Bangalore21h ago
-
RAG + Agentic AI Engineer (India) (Remote) INR 2500K-3500KAccess Control | Agent Orchestration | Asynchronous programming | Auditability | BM25Growth opportunities | Ownership and autonomy | Remote workMid-level Full TimeMaharashtra, Pune, India R22h ago
-
Staff Engineer, Data Engineering INR 2400K-3100KAPIs | Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, India22h ago
-
Manager- Data Aggregation-304 INR 1200K-2500KAirflow | Amazon Redshift | Data Deidentification | Data Governance | Data ManagementMid-level Full TimeBengaluru, Karnataka22h ago
-
Mid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN23h ago
-
Sr. Staff Engineer (Java Fullstack or Python, AI) INR 2475K-3500KAWS | Angular | Anthropic | Azure OpenAI | Bias MitigationFamily well-being benefits | Health benefits | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India23h ago
-
Business Intelligence Engineer INR 2000K-2900KAgile | Bitbucket | DAX | Data Governance | Data WarehousingFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R1d ago
-
AWS | BigQuery | ClickHouse | Cloud infrastructure | Data EngineeringFully remote | Inclusive organization | Remote-first cultureMid-level Full TimeIndia R1d ago
-
Data Engineer INR 1000K-2100KApache Airflow | Apache Spark | Azure | CI/CD | DatabricksEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India1d ago
-
Mid-level Full TimeMaharashtra, Pune, India1d ago
-
Senior Software Engineer (Microsoft .NET/Azure cloud) INR 2829K-4000K.NET | API Management | APIM | Angular | App ServicesHealth insurance | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India1d ago