GCP Data Engineer Job at Compunnel Inc., McLean, VA

aitoZWYyZTBVUFFKeHlFWXFZSzZYcWhqMnc9PQ==
  • Compunnel Inc.
  • McLean, VA

Job Description

Title: GCP Data Engineer

100 % Remote

Senior Consultants.

Position Purpose: Implements simple to complex data ingestion and pipeline processes on Google Cloud Platform using industry-standard best practices. Designs, develops, configures, tests, debugs, and documents these processes based on business requirements and technical architecture specifications. Supports and troubleshoots existing ingestion and pipeline processes and data.

Responsibilities:

  • Design and implement Data ingestion and pipeline workflows as per business needs and technical specifications.
  • Works independently and collaboratively with team; keeping the project team and leaders in the loop.
  • Prepares detailed specifications from which data ingestion and pipeline processes are developed.
  • Develops and implements technical solutions by code development and tool configuration.
  • Querying databases using SQL (Structured Query Language) to extract relevant data for analysis and troubleshooting of defects/bugs.
  • Responsible for the development and execution of testing and implementation plans. Can perform unit, system, integration, and user acceptance testing. Documents results.
  • Participates in project planning and development or assumes responsibility for a project of limited scope.
  • Provides options for and estimates of possible coding.
  • May be responsible for the completion of a phase of a project or small projects depending on complexity.
  • Estimates and tracks time required to complete work, for project budgeting and financial tracking.
  • Conducts and participates in reviews of solution designs, configurations, and code.
  • Provides technical expertise for project and baseline support teams.
  • Adheres to security standards to comply in the handling/processing/storing of sensitive data.
  • Adheres to development standards and provides development standards recommendations.

Education Level: 4-Year Bachelor's Degree

Years of Experience: 3+ years of professional experience

Technical Skills and Qualifications:

  • Must have:
  • Google Pub/Sub
  • BigQuery
  • Google Dataform
  • Data ingestion to Big Query experience
  • Google Cloud Storage
  • Cloud Composer
  • GitHub
  • SQL
  • Software SDLC
  • Good to have :
  • DBMS connectivity and interaction experience (SQL Server, DB2, Oracle)
  • Experience calling RESTful API’s and SOAP Webservices
  • Experience integrating with other Google resources, databases, and services
  • BigQuery Query Optimization
  • Jira
  • Confluence
  • Dataflow
  • Terraform
  • Python
  • Agile
  • CI/CD tool

Job Tags

Remote work,

Similar Jobs

International Leadership of Texas

Pre Kindergarten Teacher Job at International Leadership of Texas

This is for the 2025 - 2026 School Year Compensation package for certified teachers starting at $57,000* Compensation package for non-certified teachers starting at $54,000* Primary Purpose: Provide students with appropriate learning activities and experiences...

The ONeil Search Group

Accounting Manager/Controller Job at The ONeil Search Group

 ...Boutique NY law firm is seeking an Accounting Manager/Controller to join their office. Minimum 5 years accounting experience Law firm experience and a CPA designation required Experience with 3E accounting software preferred, but not required Primary Job Functions... 

Bernard Nickels & Associates

Corporate Event Planner Job at Bernard Nickels & Associates

 ..., creative, and highly organized someone who enjoys managing events from start to finish and isnt afraid to roll up their sleeves....  ...trainings, appreciation outings) and internal employee events. Coordinate sales/prospecting events with Marketing and Sales, including... 

Visionary Innovative Technology Solutions LLC

Inventory Developer Job at Visionary Innovative Technology Solutions LLC

 ...Position: Ansible Developer Location: McLean, VA (Onsite) Duration: 6+ Month Job Description: Key Responsibilities: Develop, manage, and optimize Ansible playbooks, roles, inventories, and handlers. Work with Jenkins pipelines (declarative/scripted... 

LMC

Supervisor, Rebate Strategy & Credit Analysis Job at LMC

LMC is a leading buying group for a network of independent family-owned building material companies across the US. As their buying group, LMC negotiates and facilitates procurement opportunities for the most desired brands in the lumber and building materials industry...