-
Navigating the Perils of Perl Mocking: A Debugging Journey
As a software engineer, I often find myself deep in the trenches of testing, ensuring the code I write is not just functional but also resilient. Recently, I embarked on a refactoring project that involved moving a script’s functionality into a new Perl module, App::Workflow::Controller. This module’s job was to orchestrate a few tasks: query…
-
Early Access: Inserting JSON data to BigQuery from Spark on Dataproc
Hello folks! We recently received a case letting us know that Dataproc 2.1.1 was unable to write to a BigQuery table with a column of type JSON. Although the BigQuery connector for Spark has had support for JSON columns since 0.28.0, the Dataproc images on the 2.1 line still cannot create tables with JSON columns…