Friday, 14 April 2017

Flapjack recipe

6oz butter or margarine
3oz demerara sugar
3 tablespoons of syrup (use plenty)
8oz quick cook rolled oats
Pinch of salt

Melt the fat in a saucepan, over a gentle heat.
Mix in sugar and syrup.
Mix in oats and salt.
Stir well and put into a greased tin and press down.
Bake for 30 - 35 minutes in the centre of the oven at 375°F (this might be abit too hot).

When cooked, leave to stand for a few minutes, then cut across into squares.

Leave in tin until cold.

Tuesday, 14 March 2017

TED Talk - 10 ways to have a better conversation

https://m.youtube.com/watch?v=R1vskiVDwl4

Celeste Headlee

1) don't multi-task - be present | in that conversation moment | don't be half-in the conversation
2) don't pontificate - enter every conversation assume that you have something to learn | everyone you will every meet knows something you don't | always be prepared to be amazed.
3) use open-ended questions
who
what
where
when
why
how
what was that like | how does that feel
4) go with the flow (let thoughts enter your mind, and let them go again)
5) if you don't know - say that you don't know | err on the side of cautioni
6) don't equate personal experience with their's | it's not a competition | it's not the same | all experiences are individual | it's not about you
7) try not to repeat yourself
8) stay out of the weeds - people don't care about names / dates / detials | people care about you, what you like, what you have in-common
9) listen - listening is the most important skill - if your mouth is open, you're not learning | no man ever listened his way out of a job
10) be brief - be a mini-skirt - short | to the point - summaries | be interesting, be long-enough to cover the subject.

Saturday, 18 February 2017

ZappySys SSIS Tasks - Importing data from SQL SERVER into Redshift


Recently, I've been using AWS (Amazon Web Services), primarily using the Redshift database as the platform for a Data Warehouse.
One of the challenges has been how to automate the data load from SQL SERVER, to Redshift.
There's various best practices - one of those is to store flatfile data in S3, prior to ingesting this into Redshift via the Redshift COPY command.
S3, or AWS S3 is a "simple storage service" offered by Amazon - the data is stored in "the cloud".
AWS offers AWS CLI (command line interface) to help achieve this task.
A rough guide would be to perform the following tasks
  1. Using SSIS (SQL SERVER INTEGRATION SERVICES) to read data from SQL SERVER, and create flatfiles.
  2. Using AWS CLI, push this data into an S3 bucket.
  3. Within Redshift - issue the COPY command, to pull the data from S3 into a Redshift table
  4. Optionally, issue another S3 command and move the files into an "Archive" folder - for better house keeping.
To achieve these 4 steps could be time consuming to automate.

This is where ZappySys comes in to help streamline this process, and cut out hours of development.
"ZappySys is a USA based software development company. 
We specialize in Data integration, Business Intelligence, 
Cloud computing and .Net Application Development."

In a nut-shell - ZappySys have developed SSIS task addon's that perform many different tasks - the one that's important for this import into Redshift is the Redshift Data Transfer task.
SSIS AWS Redshift Connector
This is equivalent to the SSIS Data Flow Task (DFT), but makes the whole process of connecting to the AWS account, Redshift cluster / database, using S3 as a flatfile staging environment a piece of cake.


SSIS Amazon AWS Redshift Data Transfer Task - Load from local file


Zappy even have recorded a straight-forward video on how to use this task to speed up the implementation.


Here's some more details (from http://zappysys.com/ to help summaries what they have to offer)

Why SSIS PowerPack?
  • Coding free, drag and drop high performance suite of Custom SSIS Components and SSIS Tasks
  • Used by many companies around the globe
  • Compatible with SQL Server 2005,2008, 2008 R2, 2012, 2014 and 2016
  • Support for 32bit and 64bit Server/Desktop OS
  • Easy to use, Familiar looks and feel and fully integrated in BIDS/SSDT
  • No license needed if you are developing/testing in BIDS/SSDT
  • Rapid update cycle and prompt support (See what’s new). We will help you over phone, web meetings and via email.
  • 30 days money back guarantee if not satisfied for whatever reason.

SSIS Integration Packs

SSIS Integration Pack offers cost effective way to accomplish your specific integration need. Click on the following link to find out more about each integration pack.

SSIS Tasks\Components by Category