Sr Data Engineer
Mc Lean, United States
A USD 156K-192K (estimate) Senior-level Contract
Tasks
- Build and manage Snowflake warehouses schemas and data models
- Build production data transformation pipelines
- Collaborate with architects business analysts and program managers
- Create incremental processing using Snowflake dynamic tables and materialized views
- Design Apache Iceberg tables in Snowflake
- Design scalable batch and streaming data pipelines
- Document technical designs data schemas and runbooks
- Implement data validation lineage tracking and monitoring
- Implement deduplication strategies
- Migrate legacy ETL workloads to PySpark and Snowflake
- Monitor and optimize Spark Snowflake and AWS costs
- Optimize Snowflake workloads using clustering and partition pruning
- Tune distributed Spark jobs for performance
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions | Airflow | Amazon CloudWatch | Amazon EMR | Amazon Redshift | Amazon S3 | Apache Iceberg | Apache Kafka | Apache Spark | Broadcast joins | CTE | Caching | Clustering keys | Continuous Deployment | Continuous integration | DBT | Data Lakes | Data Lineage | Data Monitoring | Data Validation | Delta Lake | Dynamic Tables | ELT | ETL | ETL migration | Git | GitHub Actions | Great Expectations | Jenkins | Lakehouse | Materialized views | Parquet | Partitioning | PySpark | Python | Query profiling | RBAC | Result Caching | SQL | Shuffle Optimization | SnowSQL | Snowflake | Snowflake Streams | Snowflake Tasks | Snowpipe | Step Functions | Terraform | Window Functions
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Senior-level Full TimeMcLean, VA; McLean, VIRGINIA; McLean, VIRGINIA; …4h ago
-
Senior-level Full TimeMcLean, VIRGINIA4h ago
-
Data Engineer (Expert) WA07 USD 133K-238KData Mapping | Data Modeling | Data Quality | Data Testing | ETLSenior-level Full TimeChantilly, Virginia4h ago
-
Data Engineer (Subject Matter Expert) WA28 USD 133K-238KApache NiFi | CSS | Data Modeling | Data Quality | ETLSenior-level Full TimeChantilly, VA4h ago
-
Data Engineer (Expert) WA12 USD 133K-238KApache NiFi | Data Mapping | Data Modeling | Data Quality | Data TestingSenior-level Full TimeMcLean, VIRGINIA4h ago
-
Data Engineer (Subject Matter Expert) CK16 USD 133K-238KApache NiFi | C# | C++ | Cloud Computing | Data MappingCompetitive benefits packageSenior-level Full TimeMcLean, VIRGINIA4h ago
-
System Engineer- Storage (Expert) TI28 USD 100K-150KActive Directory | Auditing | Backup and Recovery | Bash | Capacity PlanningSenior-level Full TimeMcLean, VIRGINIA4h ago
-
Mid-level Full TimeMcLean, VIRGINIA4h ago
-
Data Compliance | Database Design | Database performance | Database performance tuning | Database securityDental insurance | Health insurance | Professional development opportunities | Retirement savings plan | Vision insuranceSenior-level Full TimeChantilly, VA; Springfield, VA; Springfield, VA; …4h ago
-
API Integration | Cloud Computing | Dashboards | Data Architecture | Data GovernanceMid-level Full TimeFalls Church, VA; Falls Church, VA4h ago
-
Data Engineering | ETL | MongoDB | Object-Oriented | Object-oriented programmingSenior-level Full TimeChantilly, VA; Reston, VA; Chantilly, VA4h ago
-
AI Engineer II - Active TS/SCI w/poly clearance USD 113K-190KC# | Data Engineering | Data Governance | Data Modeling | Data StructuresDental insurance | Disability insurance | Educational assistance | Employee assistance program | Health insuranceMid-level Full TimeAnnapolis Junction, Maryland4h ago
-
Software Engineer 3 – AI/ML USD 113K-279KAWS | Artificial Intelligence | Azure | Docker | ElasticsearchAgile environment collaboration | Partial teleworkSenior-level Full TimeAnnapolis Junction, MD4h ago
-
Senior-level Full TimeLinthicum, MD; Annapolis Junction, MD; Annapolis …4h ago
-
Software Engineer USD 113K-279KApache Pig | Apache Spark | Continuous Monitoring | Data Ingestion | Data QualitySenior-level Full TimeLinthicum, MD; Annapolis Junction, MD; Annapolis …4h ago
-
Database Engineer II USD 124K-208KAWS | Agile | Confluence | Django | Docker401k match | Dental insurance | Health insurance | Immediate 401k vesting | Paid time offSenior-level Full TimeLinthicum, MD4h ago
-
Database Engineer III USD 124K-208KCloud Computing | Continuous Monitoring | Data Modeling | Data Storage | Database ArchitectureActive TS SCI clearance with polygraph | Benefits packageSenior-level Full TimeLinthicum, MD; Linthicum Heights, MD4h ago
-
Mid-level Full TimeSuitland, MD; Annapolis Junction, Maryland; Crystal …5h ago
-
Systems Engineer - Modeling and Algorithms USD 112K-160KC# | C++ | Data Analysis | Digital System | Digital system modelingSenior-level Full TimeHuntsville, Alabama; Annapolis Junction, Maryland5h ago
-
Apache Tika | Data Visualization | Language Processing | Machine Learning | MbseMid-level Full TimeAnnapolis Junction, Maryland5h ago
-
Anomaly Detection | Data Engineering | Data Lakes | Data Pipelines | Data ProcessingRegular team sessions | Remote friendly schedule | Team collaborationSenior-level Full TimeRemote, Canada (EST); San Francisco, California R5h ago
-
Aerospike | Ansible | Capacity Planning | Ceph | Configuration ManagementSenior-level Full TimeRemote, Canada; Toronto, Ontario; San Francisco, … R5h ago
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R5h ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R5h ago