Contract: Senior Data Engineer

Upwork ($UPWK) is the world’s work marketplace. We serve everyone from one-person startups to over 30% of the Fortune 100 with a powerful, trust-driven platform that enables companies and talent to work together in new ways that unlock their potential.
Last year, more than $3.3 billion of work was done through Upwork by skilled professionals who are gaining more control by finding work they are passionate about and innovating their careers.
This is an engagement through Upwork’s Hybrid Workforce Solutions (HWS) Team. Our Hybrid Workforce Solutions Team is a global group of professionals that support Upwork’s business. Our HWS team members are located all over the world.
Work/Project Scope:

• You will work with Upwork’s world-class data scientists, analysts, and engineers to create products that solve important real-world business problems in a collaborative, fast-paced, and fun environment.
• Build data pipelines and modern ways of automating data pipelines using cloud based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
• You’ll work closely with our data science team to develop new platforms, infrastructure, and tools that will allow for machine learning applications at production scale over ever-growing datasets.
• Implements enterprise data management concepts (Data Governance, Data Engineering, Data Science, Data Lake, Data Warehouse, Data Sharing, Data Applications)
• As a data engineer on our team, you will play a key role in developing our next-generation data science infrastructure and underlying core technologies.
• Monitor and detect performance issues on Databricks and Spark ETL Pipelines and suggest improvements both on tuning and rewriting.

Must Haves (Required Skills):

• Strong proficiency in Spark and PySpark for distributed data processing and analytics.
• Knowledge of workflow management tools like Airflow for orchestrating ETL pipelines.
• Experience in working with Cloud providers such as AWS or GCP or Azure.
• Previous experience working on startups and/or innovation teams
• Familiarity with version control systems like GitHub for managing codebase.
• Experience designing and implementing large-scale, distributed systems
• Experience with relational models (snowflake) and NoSql models (graph databases, DynamoDB)
• Extensive hands-on experience (3+ years) working as a Big Data Engineer or Data Engineer or Developer in large-scale data processing and analytics projects.
• Experience with CI/CD pipelines using Jenkins for automated build, test, and deployment.
• B.S., M.S., or Ph.D. in Computer Science (or a related field) or equivalent work experience
• Excellent presentation and communication skills, both written and verbal communication
• Experience in multi-threaded software development (or some form of parallelism)
• Experience with ETL processes and query optimization in Databricks.

Upwork is proudly committed to fostering a diverse and inclusive workforce. We never discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical condition), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.
To learn more about how Upwork processes and protects your personal information as part of the application process, please review our Global Job Applicant Privacy Notice