In SQL you can use the HASHBYTES function to generate the hash of an input, the output is the binary represention of the hash. If you want to get this as a unicode value then you can use the below code. This gives a result of ba7816bf8f01cfea414140de5dae2223b00361a396177a9cb410ff61f20015ad which can be Read more…
When importing a flat file provided by a client into a SQL table the data in the file is often a bit of a mess and it can be easier to import all the columns as long strings into a loading table and to then try and figurre out the Read more…
If you have a complex table structure in SQL that you want to map into corresponding classes in your .NET Core project it might be easier to output the result of your SQL query as JSON and then deserialize the results to your object model rather than trying to map Read more…
OData is an open protocol for enabling interaction with a datasource in a standardised way via a RESTful API. Theoretically using OData in combination with Entity Framweork should provide a simple way of providing access to SQL (or other) data via API, this is indeed the case but setting things Read more…
If you want to use Entity Framework to access pre-existing SQL tables (the database first approach) then providing they’re all keyed up correctly it’s possible to generate all the required classes and the DB context for them with just a few commands. First you need to install the following 3 Read more…
Outputting a SQL table to a CSV file on an SFTP site is pretty much the same as outputting it to a local CSV file but with the added step of using SSH.NET to upload the stream. Full code for this can be found here. GetSqlRowsAsync Usage Usage – GZip Read more…
This post demonstrates how write a SQL table out to a local CSV file, the full code for this can be found here. GetSqlRowsAsync This returns an IAsyncEnumerable of DataRows, IAsyncEnumerable has been newly introduced with C# 8.0 and it allows results to be streamed back to the caller as Read more…
Similar to how I’m uploading data to an SFTP the below example streams a SQL table directly to a Google Cloud Storage object. Full code for this is here. Usage Here the StreamWriter needs to be flushed before the upload to GCM is initiated as otherwise the StorageClient will finish Read more…
In order to transfer data from a Google BigQuery table into SQL I first export it to Google Cloud storage and then stream it directly into into my SQL table using SqlBulkCopy and a modified version of the CsvDataReader from CsvHelper. This post demonstrates how to load data from Google Read more…
As part of a recent project I’ve had to download a gzipped file of product details from a client endpoint and to load these products into a local SQL database. Although this is easy enough to do in discrete synchronous steps as below what I really wanted to do was Read more…