Data Engineer (Full/Part-Time)
Tasks
- Build and maintain data quality checks
- Configure BigQuery RBAC and column level security
- Handle API delays authentication and uptime issues
- Implement PII masking and access restrictions
- Investigate pipeline failures and perform root cause analysis
- Maintain GDPR CCPA compliance controls
- Maintain documentation runbooks and change logs
- Manage ETL pipelines and integration logic changes
- Manage incident classification and vendor coordination
- Monitor data pipelines and alerts
- Monitor source systems for schema and data type changes
- Optimize BigQuery query performance and warehouse costs
- Validate data for freshness accuracy completeness
Perks/Benefits
Skills/Tech-stack
Anomaly Detection | CCPA | Cause analysis | Clustering | DBT | Data Pipeline Monitoring | Data Quality | Data Validation | Data pipeline | Daton | ETL | Fivetran | GDPR | Google BigQuery | Incremental loading | PII masking | Partitioning | Pipeline monitoring | RBAC | Root Cause Analysis | Root cause | SQL | Slack | Table Clustering | Table Partitioning
Education
N/A
Roles
Related jobs
-
NAS Tech Ops - Cont 165771 INR 1500K-2000KDatabricks | Excel | Hyperion Essbase | Power BI | Power QueryMid-level Contract TemporaryPune, IND-MH, India3h ago
-
Principal Consultant- Snowflake INR 2040K-3285KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon EMRSenior-level Full TimeIndia-Bangalore7h ago
-
Senior-level Full TimeIN-TN-Chennai7h ago
-
DevSecOps INR 2000K-2300KAccess Management | Azure DevOps | Azure Entra | Azure Entra ID | Azure Key VaultMid-level Full TimeIN-KA-Bangalore7h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India7h ago
-
Entry-level Full TimeHyderabad, Telangana, India8h ago
-
Associate - Data Engineer INR 1500K-2345KData Analysis | Data Engineering | Data Management | Data Pipelines | Data ProcessingMid-level Full TimeIndia9h ago
-
Business Intelligence Engineer INR 805K-1024KAgile | Dashboard Design | Data Governance | Data Quality | Data VisualizationFlexible hybrid schedule | Health and life insurance | Hybrid work model | Paid time off | Pension and retirement benefitsMid-level Full TimeHyderabad, India9h ago
-
Sr. Snowflake Data Engineer - Risk Technology INR 2500K-4000KClustering keys | ELT | ETL | Micro-partitioning | PythonSenior-level Full TimePune, India9h ago
-
Senior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior AI Engineer INR 3125K-5000KAI Studio | AWS Bedrock | AWS SageMaker | Asynchronous programming | AutogenSenior-level Full TimeBangalore, Karnataka, IN12h ago
-
AI Engineer INR 2520K-3880KActive Learning | Azure Cognitive | Azure Cognitive Services | Azure OpenAI | Azure OpenAI ServiceFamily support | Learning and development opportunities | Life Coverage | Medical coverage | Relocation supportSenior-level Full TimeHyderabad, TS, India12h ago
-
Mid-level Full TimePUNE, MAHARASHTRA, India13h ago
-
Snowflake DBT Developer INR 300K-370KAmazon Redshift | Apache Airflow | Azure Synapse | BigQuery | CI/CDRemote workSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
DE&A - Core - Data Engineering - Microsoft SQL Server INR 400K-540KAWS | Apache Spark | Azure | Cloud platform | Data ModelingEntry-level Full TimePune, Maharashtra, India15h ago
-
Staff Software Engineer(MLOps) INR 2857K-4500KAWS Athena | AWS DynamoDB | AWS Glue | AWS SageMaker | Apache AirflowHybrid work model | Mentorship cultureSenior-level Full TimeBangalore15h ago
-
Senior-level Full TimeBengaluru, Karnataka, India16h ago
-
Senior Lead Software Engineer - DataBricks, SQL INR 1200K-2000KAPI | AWS | Cloud platform | Data Lake | Data WarehouseSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Azure Data Consultant INR 2516K-3100KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBengaluru, KA, IN20h ago
-
Z2_Sr. Developer|Back-end technologies INR 2500K-4144KCI/CD | Caching | Data Management | Docker | ETLSenior-level Full TimeBangalore, KA, IN20h ago
-
Senior-level Full TimeBangalore, IN, 56211020h ago
-
Technical Lead Software Architect INR 2500K-4500KAPI Gateway | AWS | Agent systems | Agile | AuthenticationSenior-level Full TimeIN: Lilly Hyderabad, India20h ago
-
Senior-level Full TimeIN: Lilly Hyderabad, India20h ago
-
Expert Support Engineer - Snowflake INR 2000K-2400KAWS Glue | Access policies | Advanced SQL | Agile | Apache AirflowSenior-level Full TimeBangalore, India20h ago
-
Software Engineer INR 1200K-1800KAPI Gateway | AWS Lambda | AWS RDS | AWS RDS PostgreSQL | AWS SNSContinuous learning | Onsite work 5 days per week | Relocation available | Team collaborationMid-level Full TimeChennai, Tamil Nadu, India20h ago