There is a variety of ways of getting data out of BigQuery using the API including streaming the results into memory and creating a file for download, however if you need to download a large amount of data then this will initially need to be exported to Google Cloud Storage Read more…
As part of a recent project I’ve had to download a gzipped file of product details from a client endpoint and to load these products into a local SQL database. Although this is easy enough to do in discrete synchronous steps as below what I really wanted to do was Read more…
I usually access Azure Blob Storage by using a SAS key but I am trying to move everything over to KeyVault and Managed Service Identities (MSI) to improve security and secret management. During this process I kept on receiving the following error. I could connect to the container using my Read more…
While there seems to be plenty of resources and guides out there to help users create an API there seems to be much less guidance on how to create a client for accessing an API. I’m fine with calling an API using HttpClient or through a library such as RestSharp Read more…
I’ve been updating our company’s Christmas bake-off site and as part of the update I added the Microsoft.Identity.Web project to help with authentication and accessing the Graph API. This project doesn’t currently have a NuGet package though one is apparently in the works so I included it by taking a Read more…
I’ve previously posted about how to cope with nullable values retrieved from a SqlDataReader but it’s also necessary to account for nulls when passing values through to a SQL operation such as a stored procedure. sp__set_completed.sql If you want you’re stored procedure to accept nulls then you first need to Read more…
I maintain a library called PGPCore for using PGP encryption in C#, in order to test how this performs when processing large files I needed to create a large file full of random data to check it was encrypting/decrypting as expected. After a bit of searching the answers to this Read more…
I use Bootstrap 4 as the framework for most sites that I build and I’m mostly happy with how it works, though one area where I think it could be a bit more user friendly is in Form Validation. This works fine for basic validation tasks but doesn’t make it Read more…
I recently needed to mask out some characters of a credit card string so that only the last 4 were displayed. Surprisingly there doesn’t seem to be many good examples of this so I decided to put together something myself and I figured it would be more useful as an Read more…
I have a table in Azure Table Storage that I need to keep as a replica of a local SQL table. Adding/updating rows from the local table is simple enough but it is slightly more complicated to find rows that have been removed from the local table and therefore need Read more…