Data Engg with DQ Exp
Tasks
- Build batch and real-time data pipelines
- Define end to end cloud data architecture
- Design ETL/ELT frameworks
- Design automated data quality reconciliation frameworks
- Design enterprise data platforms on Microsoft Azure
- Enable data integration from structured and unstructured sources
- Establish data observability and monitoring
- Implement data quality checks and validation
- Implement data quality standards and monitoring
- Implement lakehouse and data warehouse architectures
- Lead architecture reviews and design discussions
- Mentor junior engineers and provide technical leadership
- Perform data governance metadata lineage and master data collaboration
Perks/Benefits
- 401k plan
- Dental insurance
- Disability insurance
- Health insurance
- Life insurance
- PTO
- Paid Holidays
- Parental leave
- Vision insurance
Skills/Tech-stack
ARM Templates | Anomaly Detection | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Functions | Azure Purview | Azure SQL | Azure SQL Database | Azure Security | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Data Management | Data Modeling | Data Observability | Data Processing | Data Quality | Data Reconciliation | Data Vault | Data profiling | Deequ | Delta Lake | Distributed data | Distributed data processing | Event Hubs | Great Expectations | Informatica Data Quality | Infrastructure as Code | Lakehouse | Master Data | Master Data Management | Metadata Management | Microsoft Purview | Monitoring and Logging | Monte Carlo | PySpark | Python | SQL | SQL Database | Stream Analytics | Synapse Analytics | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R29d ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KAnalytics engineering | Azure | CCPA | CI/CD | DORA Metrics401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R7h ago
-
AI Search | AI Security | AWS | AWS Bedrock | Agent memoryHybrid work | In-person interviewSenior-level Contract Full TimeJersey City, NJ, United States R8h ago
-
Senior Data Engineer USD 109K-163KAI | API | Analytics Platforms | Analytics solutions | Apache Spark401k | Adoption Assistance | Defined contribution | Discount programs | Employee assistance programsSenior-level Full TimeJohnston, IA,Iowa,United States9h ago
-
Sr. Databricks Consultant - Top Secret Clearance USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDTop Secret clearanceSenior-level Full TimeFAIRFAX, VA, United States9h ago
-
Sr. Databricks Consultant - TS/SCI-FSP USD 175K-250KAWS | AWS S3 | Apache Spark | Azure | Azure DataAdditional funding contingent | Benefits package | Travel as neededSenior-level Full TimeFAIRFAX, VA, United States9h ago
-
Mid-level Full TimeKing George, VA, United States9h ago
-
Sr. Databricks Consultant - DHS Public Trust USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDSenior-level Full TimeWork from home, VA, United States9h ago
-
Data Architect (Hybrid - St. Paul, MN) USD 130K-174KAccess Control | Azure | Azure Backup | Azure CLI | Azure DataHybrid work | W2 employmentSenior-level Full TimeSt Paul, Minnesota R10h ago
-
Ab Initio | Agile | Data Integrity | Data Management | Data ModelingHybrid work | Local candidates onlyMid-level Full TimeDallas, Texas10h ago
-
Access Control | Azure | Azure Backup | Azure CLI | Azure DataContract extensions possible | Knowledge transfer opportunities | Remote or hybrid work availabilitySenior-level Full TimeSt. Paul, MN; St. Paul, MN R10h ago
-
Principal Data Engineer – (Hadoop/Big Data, AWS, Python, Kinesis) - Irvine, CA - Onsite - Contract to Hire - AS A USD 132K-165KAmazon Kinesis | Amazon RDS | Amazon Redshift | Amazon Web Services | Apache HBaseSenior-level Full TimeIrvine, CA10h ago
-
Principal AI Engineer – Agentic AI / Generative AI | Irvine, CA (Hybrid) | Contract to Hire | AS A USD 100K-150KAI Agents | API | AWS | Agent systems | CI/CDContract-to-hire | Hybrid workSenior-level Full TimeIrvine, CA R10h ago
-
ABAC | AWS | Access Management | Apache Iceberg | CI/CDSenior-level Full TimeBoston, MA, United States11h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeBaltimore, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeHouston, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Kafka | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeWest Palm Beach, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Kafka | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJersey City, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | AWS Glue | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeTallahassee, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Amazon SageMaker | Amazon SageMaker Studio | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeLos Angeles, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPIs | AWS | Airflow | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeFort Lauderdale, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeChicago, United States R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBoston, United States R12h ago