Staff Data Engineer, tvScientific
San Francisco, CA, US; Remote, US
R
USD 177K-364K Senior-level Full Time
Tasks
- Build batch pipelines
- Build identity data pipelines
- Build streaming pipelines
- Create documentation standards and runbooks
- Design identity resolution platform
- Enforce schema and access controls
- Expose identity data via APIs and datasets
- Implement data lineage and quality checks
- Implement identity matching logic
- Implement privacy by design pii handling
- Monitor data quality freshness and integrity
- Operationalize GDPR and CCPA requirements
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Access Control | Amazon Redshift | Amazon S3 | Apache Spark | Auditable Matching | Batch Processing | CCPA | Data Governance | Data Lineage | Data Pipelines | Data Quality | Deterministic matching | GDPR | Identity resolution | Kafka | Kinesis | Metadata Management | PII handling | Probabilistic matching | Scala | Schema Enforcement | Streaming Pipelines
Education
Roles
Regions
Countries
States
Related jobs
-
Senior Data Engineer USD 115K-145KAWS S3 | Airflow | Azure Blob | Azure Blob Storage | Blob Storage401k | Dental insurance | Discounts | Medical insurance | Paid leaveSenior-level Full TimeNew York, NEW YORK, United States R15h ago
-
BI Data Engineer (Remote WA, OR, ID & CA) USD 88K-116KAzure Synapse | C# | DAX | Data Governance | Data Modeling401k match | Health insurance | Paid Holidays | Paid vacation | Sick timeMid-level Full TimeBellevue, Washington R15h ago
-
Machine Learning Engineer USD 185K-260KAdvertising Auctions | Airflow | BigQuery | Convolutional Neural Networks | Data Pipelines401k employer match | Caregiving support programs | Comprehensive healthcare benefits | Family planning support | Flexible vacationMid-level Full TimeRemote - United States R15h ago
-
Senior Data Engineer USD 119K-161KAnalysis Services Tabular | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeDenver, CO, United States R16h ago
-
Senior Data Engineer USD 119K-161KAnalysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services Tabular | Azure DataMentorship opportunities | Remote workSenior-level Full TimeKansas City, MO, United States R16h ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KAgentic Workflows | Azure | Azure Data | Azure Data Services | Bicep401k | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R16h ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KAzure | CI/CD | Compliance | Data Lineage | Data Quality401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeRomulus, MI, United States R17h ago
-
Principal MLOps Engineer USD 150K-200KAWS | Azure | CI/CD | Docker | Git401k match | Annual tech and gadget budget | Education and training benefits | Healthcare dental vision insurance | Paid HolidaysSenior-level Full TimeRemote, US; DMV; McLean, VA; Boston, … R17h ago
-
Principal MLOps Engineer USD 150K-200KAWS | Azure | CI/CD | Container hardening | Docker401k match | Annual tech budget | Education & training benefits | Flexible work options | Health, dental, vision coverageSenior-level Full TimeRemote, US; DMV; McLean, VA; Boston, … R17h ago
-
Principal MLOps Engineer USD 150K-200KAWS | Azure | CI/CD | Docker | Git401k match | Annual snacks budget | Education and training benefits | Fully covered healthcare dental and vision | Paid HolidaysSenior-level Full TimeRemote, US; DMV; McLean, VA; Boston, … R17h ago
-
Data Engineer-Secret Clearance Required USD 100K-150KAWS | AWS Glue | AWS Lambda | AWS Redshift | Access patterns401k plan with company matching | Bereavement leave | Disability insurance | Employee assistance program | Health, dental, vision insuranceSenior-level Full TimeRemote - Nationwide, United States R19h ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Travel as neededSenior-level Full TimeWork from home, VA, United States R19h ago
-
Associate, Quantitative Front Office Engineer (AQR Capital Management, LLC, Greenwich, CT) USD 131K-185KAWS | Asset classes | Back Testing | Continuous integration | Distributed ComputingTelecommuting 2 days per weekMid-level Full TimeGreenwich, CT R20h ago
-
Apache Spark | Data Quality | Embeddings | Entity Extraction | Graph ModelingDental insurance | Health insurance | Paid time off | Retirement contributions | Vision insuranceMid-level Full TimeBoston, MA R21h ago
-
Data Engineer (Remote) USD 132K-178KAPI Integration | AWS | Data Ingestion | Data Lake | Data NormalizationRemote workMid-level Full TimeSan Francisco, United States of America R23h ago
-
AWS | Azure | Databricks | Hadoop | Kinesis401k plan | Certification sponsorship | Dental insurance | Diversity and inclusion initiatives | Learning opportunitiesSenior-level Full TimeVirginia R1d ago
-
AWS | Azure | Data Lakes | Data Modeling | Databricks401k plan | Certification sponsorship | Dental insurance | Diversity and inclusion initiatives | Learning opportunitiesSenior-level Full TimeWashington R1d ago
-
API Development | AWS | AWS Lambda | Apache Hadoop | Apache Spark401k plan | Certification sponsorship | Dental insurance | Diversity and inclusion initiatives | Learning opportunitiesSenior-level Full TimeTexas R1d ago
-
AWS | Azure | Data Architecture | Data Modelling | Databricks401k plan | Caregiver leave | Certification sponsorship | Dental insurance | Diversity and inclusion initiativesSenior-level Full TimeNorth Carolina R1d ago
-
API Development | AWS | Azure | Data Lake | Data Modelling401k plan | Certification sponsorship | Dental insurance | Diversity and inclusion initiatives | Learning opportunitiesSenior-level Full TimeNew York R1d ago
-
AWS | Azure | Data Architecture | Data Modelling | Data Pipelines401k plan | Certification sponsorship | Dental insurance | Diversity and inclusion initiatives | Medical insuranceSenior-level Full TimeMaine R1d ago
-
APIs | AWS | AWS Kinesis | AWS Lambda | Azure401k plan | Certification sponsorship | Dental insurance | Diversity and inclusion initiatives | Medical insuranceSenior-level Full TimeNew Jersey R1d ago
-
AWS | Azure | Databricks | ELT | Hadoop401k plan | Certification sponsorship | Dental insurance | Diversity and inclusion initiatives | Medical insuranceSenior-level Full TimeMichigan R1d ago
-
AWS | AWS Lambda | Amazon Kinesis | Apache Hadoop | Apache Spark401k plan | Certification sponsorship | Dental insurance | Diversity and inclusion initiatives | Medical insuranceSenior-level Full TimeMaryland R1d ago
-
API Development | AWS | AWS Kinesis | AWS Lambda | Azure401k plan | Dental insurance | Diversity and inclusion initiatives | Learning and certification sponsorship | Medical insuranceSenior-level Full TimeMassachusetts R1d ago