Sr Data Engineer
Mc Lean, United States
A USD 156K-192K (estimate) Senior-level Contract
Tasks
- Build and manage Snowflake warehouses schemas and data models
- Build production data transformation pipelines
- Collaborate with architects business analysts and program managers
- Create incremental processing using Snowflake dynamic tables and materialized views
- Design Apache Iceberg tables in Snowflake
- Design scalable batch and streaming data pipelines
- Document technical designs data schemas and runbooks
- Implement data validation lineage tracking and monitoring
- Implement deduplication strategies
- Migrate legacy ETL workloads to PySpark and Snowflake
- Monitor and optimize Spark Snowflake and AWS costs
- Optimize Snowflake workloads using clustering and partition pruning
- Tune distributed Spark jobs for performance
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions | Airflow | Amazon CloudWatch | Amazon EMR | Amazon Redshift | Amazon S3 | Apache Iceberg | Apache Kafka | Apache Spark | Broadcast joins | CTE | Caching | Clustering keys | Continuous Deployment | Continuous integration | DBT | Data Lakes | Data Lineage | Data Monitoring | Data Validation | Delta Lake | Dynamic Tables | ELT | ETL | ETL migration | Git | GitHub Actions | Great Expectations | Jenkins | Lakehouse | Materialized views | Parquet | Partitioning | PySpark | Python | Query profiling | RBAC | Result Caching | SQL | Shuffle Optimization | SnowSQL | Snowflake | Snowflake Streams | Snowflake Tasks | Snowpipe | Step Functions | Terraform | Window Functions
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Senior-level Full TimeOrlando, FL, United States5h ago
-
Data Visualization & Integration Specialist USD 115K-150KAPI Integration | Bill of Materials | Data Governance | ETL | ExcelHybrid work scheduleMid-level Full TimeMarietta, GA, United States6h ago
-
Software Engineer, Scientific Computing USD 90K-160KCUDA | Debugging | Deployment | Numerical Methods | Performance optimizationEntry-level Full TimeRedwood City7h ago
-
Entry-level Full TimeRedwood City7h ago
-
Senior-level Full TimeHoboken, NJ, United States8h ago
-
AI | Adversarial Machine Learning | Bot Detection | Data Analysis | Data IntegrityMid-level Full TimeMountain View, CA, USA10h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R17h ago
-
Senior-level Full TimeMountain View, CA19h ago
-
Staff Software Engineer, AI Integrations USD 170K-240KAgile | Alerting | Amazon Web Services | C++ | CSSSenior-level Full TimeMountain View, CA19h ago
-
Senior Principal AI Engineer USD 152K-254KData Processing | Git | Hugging Face | Language Models | Language ProcessingAdoption Assistance | Dental vision prescription coverage | Disability benefits | Employee assistance program | Health benefitsSenior-level Full TimeCambridge, United States22h ago
-
Principal / Sr Principal Data Analytics Engineer USD 98K-184KAgile | CI/CD | Data Governance | Data Modeling | Data MonitoringCompany-Paid Holidays | Disability insurance | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeFLME229, United States22h ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R22h ago
-
Sr. Principal Embedded Software Engineer USD 142K-213KADA | Automated Regression | Bitbucket | C# | C++On-site work required | Relocation assistance not provided | Travel includedSenior-level Full TimeCACM01, United States22h ago
-
Senior Machine Learning Engineer USD 134K-168KData Drift | Databricks | Ethical AI | Feature Engineering | KubernetesSenior-level Full TimeNew York, NY, United States22h ago
-
Senior-level Full TimeSan Jose, CA, United States22h ago
-
Edge AI Engineer USD 100K-150KBenchmarking | Bias Evaluation | C++ | Core ML | Edge inferenceCareer growth | Direct W2 employment | Remote work | Technical coding assessmentSenior-level Full TimeUnited States - Remote R22h ago
-
Senior-level Full TimeUnited States - Remote R22h ago
-
Senior-level Full TimeUnited States - Remote R22h ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data quality monitoring | Deep learningCareer growthMid-level Full TimeUnited States - Remote R22h ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data labeling | Data quality monitoringCareer growth | Equal opportunity employment | Remote workMid-level Full TimeUnited States - Remote R22h ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data quality monitoringKnowledge sharing | Long-term career growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R22h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100 percent remote | Career growth | Full-time W2 employmentSenior-level Full TimeUnited States - Remote R22h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R22h ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R22h ago