in Education by
Good day! I'm using cloud dlp api to inspect bigquery views by converting chunks of the data into ContentItem and passing it to the inspect request. However, I am having trouble converting the findings and saving it to a bigquery table. Before, I used an airflow DLP operator for this and it is being done automatically by passing output storage config in an InspectConfig. However, that approach won't be applicable anymore as I'm calling the DLP api per chunks of data using apache beam in java. I saw that the finding object has a writeTo() method but I'm not sure how to use it and how to save the findings with correct types into a bigquery table. can you help me with this? I'm currently stuck. thank you! what I want to do is something like this for (Finding res : result.getFindingsList()){ TableRow bqRow = new TableRow(); Object data = res.getLocation(); bqRow.set("field", data); context.output(bqRow); } but this approach wouldn't save it in bigquery with correct types, especially for getLocation as it returns something like a protobuf message type. I was trying to see if I can use the writeTo() method but I'm not sure how to use it. Thank you in advance for the help! for (Finding res : result.getFindingsList()){ res.writeTo(...) ... context.output(...); } JavaScript questions and answers, JavaScript questions pdf, JavaScript question bank, JavaScript questions and answers pdf, mcq on JavaScript pdf, JavaScript questions and solutions, JavaScript mcq Test , Interview JavaScript questions, JavaScript Questions for Interview, JavaScript MCQ (Multiple Choice Questions)

1 Answer

0 votes
by
If you use HybridInspect we'll store the findings for you to BigQuery. https://cloud.google.com/dlp/docs/how-to-hybrid-jobs If you do it yourself you will need to convert to a native BQ format like json Load protobuf data to bigquery

Related questions

0 votes
    I am trying to run a BigQueryOperator on GCC. I have already succeeded in running for BigQueryCreateEmptyTableOperator ... , content, uri=self.uri googleapiclient.errors.HttpError:...
asked May 22, 2022 in Education by JackTerrance
0 votes
    This feels like a noobish question to which I should be able to find the answer on the web, but ... JavaScript Questions for Interview, JavaScript MCQ (Multiple Choice Questions)...
asked Apr 26, 2022 in Education by JackTerrance
0 votes
    We're running multiple streaming Dataflow pipelines that always eventually hang and need to be restarted after about ... for Interview, JavaScript MCQ (Multiple Choice Questions)...
asked May 13, 2022 in Education by JackTerrance
0 votes
    I am new to python and cloud vision.I need to label ~20k images.My code although does the work, ... JavaScript Questions for Interview, JavaScript MCQ (Multiple Choice Questions)...
asked May 7, 2022 in Education by JackTerrance
0 votes
    When setup a IP-Alias via gloud command or the interface, it works out of the box. But in the ... JavaScript Questions for Interview, JavaScript MCQ (Multiple Choice Questions)...
asked Apr 26, 2022 in Education by JackTerrance
0 votes
    I tried to find out how to use firestore local emulator for python and for testing purpose. But I ... Questions for Interview, JavaScript MCQ (Multiple Choice Questions)...
asked Apr 26, 2022 in Education by JackTerrance
0 votes
    When I attempt to load data into BigQuery from Google Cloud Storage it asks for the Google Cloud Storage URI ... Developers Console? Select the correct answer from above options...
asked Feb 2, 2022 in Education by JackTerrance
0 votes
    What is the actual difference between Google Compute Engine, App Engine and Container Engine in Google Cloud Compute ... three engines? Select the correct answer from above options...
asked Feb 2, 2022 in Education by JackTerrance
0 votes
    It seems that from Google Cloud Console there is no way to delete a project. Select the correct answer from above options...
asked Feb 2, 2022 in Education by JackTerrance
0 votes
    I would like to transfer ownership of the Google Cloud project completely. By completely I mean rather than ... Thanks in advance Select the correct answer from above options...
asked Feb 2, 2022 in Education by JackTerrance
0 votes
    Is it possible to rename a Google Cloud Platform project? If so, how? I don't need to change the project ID ... . Thanks for any tips! Select the correct answer from above options...
asked Feb 1, 2022 in Education by JackTerrance
0 votes
    Google provides two cloud-based data storage services Google Cloud Datastore and Firebase (after its acquisition). ... vs Firebase? Select the correct answer from above options...
asked Feb 1, 2022 in Education by JackTerrance
0 votes
    I am on a mac and am trying to install the Google Cloud SDK (including the gcloud command line utility) ... this installation working? Select the correct answer from above options...
asked Feb 1, 2022 in Education by JackTerrance
0 votes
    (GCP) Google Cloud Platform ETL functions are supported by which of the following services in GCP? 1) Cloud ... 4) Cloud Dataproc Select the correct answer from above options...
asked Dec 24, 2021 in Education by JackTerrance
0 votes
    I am using the Google Sheets V4 Values collection and I am having trouble figuring out how to get each ... Questions for Interview, JavaScript MCQ (Multiple Choice Questions)...
asked Jul 20, 2022 in Education by JackTerrance
...