Tales From The Field Weekly Wrap Up for the Week of 11-14-2022 Live! 360

 Hello Dear Reader!  Last week was a week we have been building towards since the launch of Tales from the Field.  My favorite conference every single year, Live! 360.  Live! 360 is 5 conferences in one.    TechMentor, Visual Studio Live, Artificial Intelligence Live, Cloud & Containers Live, & SQL Server Live.  

Much like the SQL community became the Microsoft Azure Data Community SQL Server Live is largely about the Data Community as a whole with sessions on Synapse, COSMOS, Azure Arc Data Services, SQL Server 2022, Power BI, and many other topics. 

My favorite part about this conference is the organizers and the people who attend.  Of course, a big bonus is I get to see friends of my and other Microsoft colleagues, and that is always incredible.  But these organizers are something else.  Everyone I get to come here immediately understands how great they are to work with, what an amazing job they do taking care of the attendees, the speakers, & the staff involved.  I've been presenting at Live! 360 since 2012 at the first SQL Live event.  The organizers have been the same this whole time.  They are great people, that you just love to work with.

The audience at Live! 360 is also different than what I find at most community events.  This is a much more developer & enterprise customer centric conference, and it forces you to look outside of the traditional DBA events.  I started my technical life as a developer, and it is a chance to stretch my old technical skills.

This year I had some fun and created several videos where I was walking up each day.  I will post those soon, and we have a big surprise for you this week when we will drop a whole lot of Live! 360 content on Thanksgiving Day!

"So Balls", you say, "When do we get to the wrap up?"

I hear you Dear Reader. Away we go!

SUNDAY 11-13-2022

This was a great event.  My colleagues Josh Luedeman (@JoshLuedeman | Twitter), Buck Woody (@BuckWoodyMSFT | Twitter), & myself started the week by delivering our Hands on SQL Server Ground to Cloud workshop on Sunday!  

If you didn't make it and would like to take the course, I have good news for you.  The whole SQL Server Ground to Cloud course is posted on GitHub and you can access it here!

TUESDAY 11-15-2022

"WHOA, WHOA, WHOA BALLS!", you say.  "What happened to Monday?". 

I was busy working with customers and setting up the Microsoft Booth for the conference on Monday Dear Reader.  There were great pre-con's underway by Davide Mauri (@mauridb | Twitter), Thomas LaRock (@SQLRockstar | Twitter), Karen Lopez (@DataChick | Twitter), and many more.  We had a meet and great with speakers and attendees, dinner, then bed, because we had to be up early for the keynote!

Tuesday kicked off with a Keynote by Henk Boelman (@hboelman| Twitter) and Buck Woody AI for Good - Using the Intelligent Data Platform to Create Assistive AI.

During the keynote Buck started off by showing how he assisted the owner of a grocery store with the Microsoft Intelligent Data Platform.  We used Azure Synapse Link for Azure SQL Database to create a seamless workflow migrating OLTP data to our data warehouse. Buck then used Power BI in an Azure Synapse Analytics Workspace to generate reports going against the real time data.

That's great Henk replied.  Buck helped the seller.  Henk wanted to empower the shopper.  He gave an example of someone with sight impairment.  He show how to train a voice assistant, which was amazing and a little scary.  He could then use that voice assistant, using his voice, to say anything he typed.

He then DELETED HIS DEMO TO SHOW US HOW TO REBUILD IT!! Talk about high stakes.  I don't think Buck will complain about me typing in a demo again..... actually he will.  He has.  He has complained about me typing in a demo. 

Henk then used ML Flow to train a synaptic model that could verify and describe items using a camera.  He then created a work flow using both models so he could scan an item and use his voice assistant to read the contents.  In this case a can of Sprite.  It not only read the can, it read out the calories and ingredients!

But that's not all.  Tuesday also had our LIVE SHOW!  Yes, we were live from Live! 360 with special guest's Thomas Larock & Buck Woody!

I Hosted!!! Want to see who won?  ....watch the video!

WEDNESDAY 11-16-2022

Wednesday started off with in a really nice way.  There's this really great guy on the other side of the Pond named Hugo Kornelis (@Hugo_Kornelis| Twitter).  Hugo is battling a really tough disease.  He has blogged about it prolifically. He's a good man.  He's a good friend.  We all want him to get better.  Some months ago another of his very good friends reached out to many of us, and we all spread the word behind the scenes and we all got t-shirts that said #TeamHugo.  At our conference and the PASS Summit out in Seattle, many people wore a shirt and took pictures sending our love to Hugo on Wednesday.

My friend Ginger Grant (@DestertIsleSQL | Twitter) and I had our picture taken by Buck supporting our friend. Like I said really nice way to start off the day.

The majority of Wednesday was spent working in the Microsoft Booth and interviewing some people for this Thursday's show!  Davide, Karen, and Alan Hirt (@SQLHA | Twitter) all amazing people in the own right, sat down with me for interviews.  Lunch was the Bird's of a Feather luncheon where we sit with attendees and talk about anything they want to discuss.  I had a full table and we had a lot of great discussions.  Some performance tuning, some Azure related, some analytics, some Azure Security and Azure Policy based questions.

At the end of the day we had a quick dinner out, before heading back to the dessert luau.

At this luau Tom had insisted one of his co-workers go up and participate in the show.  She repaid him by ensuring he would have to go up later.  When his name was called, I could see him shrinking away.  He clearly wanted to pull his hat down, and step further in the shadows so he would not have to go on stage.  It was apparent.  He really wanted this to pass over.

So I did what any good.... no scratch that, any truly great friend would do.

I held my hand up high and yelled at the top of my lungs, "HE'S RIGHT HERE!  THOMAS LAROCK IS RIGHT HERE! IT'S OK I FOUND HIM."

Naturally, when he took the stage the next name called could not be found.  The man on stage said he needed someone.  Thomas leaned over and gave him a name.  "BRADLEY BALL", the man bellowed.

I looked at Josh shrugged and said, "Yep.  Seems fair.", and walked up to the stage.  After that it was time to head back to the hotel room because I had to present at 8 am.  Oh, if you want to see what happened, watch the video. 

THURSDAY 11-17-2022

First session of the day was me presenting Indexing Internals for Developers & DBA's.  The audience was amazing.  We had almost 100 people in the room.  Great crowd, great feedback, really wonderful follow up questions and conversations with attendees.  My thanks to them, without attendees showing up in the room speakers cannot do what we do.  Over half of my audience was developers, and I love it when we discuss concepts.

SQL Server is an application.  It is written by developers.  It is used by DBA's.  We live it we breath it, but we should never forget it is an application.  Developers & DBA's must work hand in hand to exchange knowledge in order to be successful in any enterprise.  The best places I've ever worked have great interpersonal relationships that span IT teams.  They have to.  We all depend on one another. 

Next up was the SQL Server Live! Panel Discussion: Azure Cloud Migration Discussion. Buck, Karen, Alan (filling in for Ginger), and myself were on the panel and Thomas was our host. This was a great Q & A with the audience were they asked us questions and we gave them answers. There were lot's
of great questions from "how do I convince my boss to move to Azure", "does the fact that we are using M365 help us in a migration", to "what are the gotcha's", "what mistakes have you seen made", "what are the best strategies" were asked.  Two people working for Microsoft PG's and two Microsoft Data Platform MVP's with over 25 years of being MVP's did our best to give out the answers.

Once again, amazing attendees!

Next up I presented Azure Synapse Serverless Pools: POLARIS DEEP DIVE.  I love this session.  This is a fun one where we discuss the architectural differences between Dedicated Pools and Serverless Pools.  I show a bunch of demos, the last is a customized SQL Stress test against two external tables hitting the same object to show the concurrency scale of the Polaris engine on Serverless Pools. 

Then we talk about some architecture patterns.  I love giving this talk to user groups or conferences.  Serverless Pools are one of my favorite new products to use in Azure Synapse. I wish I got a picture of the room and the great audience.  Alas I did not, I was busy talking, answering questions, and having a
good time with the crowd and I forgot to take a picture.

The final session of the day was the NEXT? LIVE! 360 Networking Event.  Another event were we the speakers were 1:1 with the audience.  Any attendee who wanted to come and ask us questions could.  Questions we received!  We had questions on data modeling, secure data centers, replication, SQL Server 2022 and why we should upgrade from SQL 2019, tips on migrating from SQL 2012 to 2022 including a discussion on how to use the Query Data Store, and more.

Here's a quick video summarizing the day!

All of that and we also had the Tales from the Field Community Round Table!! We recorded this last week because Josh and I were both delivering sessions during our normal broadcast time.  Great discussion up front about Thanksgiving & Time travel.

Of course, OUTSTANDING content provided to the community from:

Neeraj

• So you want to talk at conferences? This is what its like.  by Todd Motto Twitter @toddmotto

Bradley

• Pro SQL Server 2022 Wait Statistics Book by Thomas LaRock Twitter @SQLRockstar

Andres

• Azure Purview Deployment Checklist by Zeinab Mokhtarian 

Josh

• PowerBI Row Level Security by Thomas LeBlanc Twitter @TheSmilingDBA

Neeraj

• Introducing the SQL Server 2022 blog series - Microsoft SQL Server Blog by Bob Ward Twitter @bobwardms

Bradley

• Synapse Spark Delta Time Travel by Liliam Leme Twitter @LemeLiliam

Andres

• Azure Stream Analytics releases slew of improvements at Ignite 2022: Output to Delta Lake and more!  by Ajeta Singhal Twitter @ajeta_singhal

Josh

• Four Different ways to Incorporate Azure Synapse and PowerBI  by Ginger Grant Twitter @DesertIsleSQL

Neeraj

• Best Thanksgiving Deals by TheBlackFriday.com Twitter @theblackfriday

Bradley

• Performance Tuning Table Visuals With Filters Applied In Power BI by Chris Webb Twitter @cwebb_bi

Andres

• Optimize your Stream Analytics job’s performance using Job Diagram Simulator by Alex Lin

Josh

• DAX Date Calculations Cheat Sheet by Arthur Graus Twitter @ArthurGraus

WRAP IT UP

This was an amazing week.  A busy week.  A week to see old friends, make new ones, and help people learn. 

Remember this week there are no Live Tales from the Field shows, HOWEVER we WILL DROP NEW CONTENT on Tuesday & Thursday just for you!

As always Dear Reader, I hope you have a happy holiday weekend if you celebrate, as always Thank You for stopping by.

Thanks,

Brad

Tales From The Field Weekly Wrap Up for the Week of 10-24-2022

 

Hello Dear Reader! This past week was an extremely fun time over at the Tales From The Field show!  Fall is here, the leaves change and fall in Florida very quickly, & today is Halloween!!!  Halloween is my favorite holiday of the year.  It is also my daughter's birthday, which makes it extra special!

This is my favorite holiday because everyone can participate in the holiday, the cost to celebrate is low, & everyone is there to give freely.  We will be giving out candy bags, and the house is decorated in a Nightmare Before Christmas theme!  

Decorated while I listened to Wrexham AFC streaming in my earbuds.  Nothing better than listening to Mark Griffiths (Twitter | @m_griffiths92) talk about the pies or bursting my ear drums as Paul Mullin scores away!

Hopefully all of you will have a fantastic, candy filled, costume wearing day today!

"So Balls", you say, "what happened on the show last week!?!".

Ahh, thank you Dear Reader for keeping me on track!  Off to the recap!

TUESDAY OCTOBER 25TH

We had the great Karen Lopez (Twitter | @DataChick) on the show.  Karen is an 11 time Microsoft Data Platform MVP, a NASA Datanaut, & a Senior Project Manager & Architect at InfoAdvisors.  As the world re-opens and we look at traveling for work and conferences again, we discussed Tips & Tricks as well as #KarensTravelStories. 

Josh hosted the show.  I shared the crazy story of my bachelor party flight to New Orleans, somehow I was disqualified, Andres WON!!  Andres will be the host next Tuesday!!  There was something weird going on about Andres, Josh, and a VENMO payment.... let's just say Dear Reader, I have my suspicions. 

THURSDAY OCTOBER 27TH

We had Chris Ayers (Twitter|@Chris_L_Ayers) join us for the Community Round table on Thursday. 

Chris is a Senior Azure FastTrack Customer Engineer that is DevOps & Developer focused.  Chis is part of the same FastTrack team that Neeraj, Josh, Andres, & myself are all part of. We talked about DevOps Days Tampa Bay 2022 and some of the upcoming presentations and events Chris has planned. 

We covered a ton of great content on the show, here's a summary of the posts:

Neeraj 

a. MY BEST 61 TRAVEL TIPS TO MAKE YOU THE WORLD’S SAVVIEST TRAVELER  by Nomadic Matt Twitter @nomadicmatt 

Bradley 

a. Starting with brand new Azure AD Lifecycle Workflows – Part 1by Pim Jacobs Twitter @PimJacobs89 

Josh 

a. The Points Guy by The Points Guy Twitter @thepointsguy 

Andres 

a. Deriving real-time intelligence about the physical world with Azure Percept and Azure Digital Twins  by Nabeel Muhammad Twitter @abrsazi 

Neeraj 

a. Parallelism in SQL Server Execution Plan by Amhad Yaseen Twitter @AhmadZYaseen 

Bradley 

a. Synapse Delta Lakehouse and Power BI Enterprise Big Data Worked Example. Part 1: Start With the End in Mind  by Rishi Sapra Twitter @rsaprano 

Josh 

a. Tech Conference Travel Tips by Una Kravets Twitter @Una 

Andres 

a. Securing access to Azure Data Lake Gen 2 from Azure Databricks by Nick Hurt Twitter @Nicholas_Hurt  

Neeraj 

a. More Consistent Execution Plan Timings in SQL Server 2022 by Paul White Twitter @SQL_Kiwi 

Bradley 

a. Mastering DP-500: Synapse Serverless SQL and file types – the ultimate guide!  by Nikola Ilic Twitter @DataMozart 

Josh 

a. 16 Short Funny Travel Stories That'll Make You Laugh Out Loud by Jessie Festa Twitter @JessonaJourney 

Andres 

a. Best practices for designing a Microsoft Sentinel or Azure Defender for Cloud workspace by Tiander Turpijn Twitter @TianderTurpijn 

 WRAP IT UP

Ok Dear Reader it's time to land this plane.  Put your tray tables in their upright and locked positions, take small children by the hand, and DON'T FORGET we are live this Tuesday & Thursday at 1 pm EST!  Comment on the stream on any of our Twitter pages, Youtube Show page, or my Linkedin page as we are streaming and your comments will make it onto our show!

As always Dear Reader, thank you for stopping by.

Thanks,

Brad

SQL Live 360 Kicks off Today!

Hello Dear Reader!  Today in beautiful Orlando FL at the Loews Royal Pacific Resort the Live 360 Conference kicks off.  Live 360 combines 4 different conferences into one.  Visual Studio, SharePoint, SQL Server, and Cloud & Virtualization all have their own conferences.  I’m helping to kick off the SQL Live 360 by presenting not once, not twice, but three times today!  

Before we dive into the content I want to say a big Thank You to my wife Silva.  Every time I’m presenting at a conference she’s taking off work to be at home and manage the kiddos.  Without her none of this is possible for me.  Thanks Silva!

“So Balls”, you say, “What are you presenting on?”

Excellent question Dear Reader.  We will be kicking off the day with Trimming Indexes Getting Your Database in Shape, next up is Transparent Data Encryption Inside and Out in SQL Server 2012, and we end the day with the Page & Row Compression Deep Dive in SQL Server 2012.  Conferences are expensive and I want to make sure that you get the most out of your experience.  So to help you decide if you should be spending your time with me, I’m placing the decks and demos online now.  They are also live on the Resource Page.  Attendees should have a copy of all of this information on their conference CD, but just in case you didn’t find it here we go!

KICKING IT OFF WITH A BANG

If you’re in town for the conference I hope you get a chance to stop by.  Here are the abstracts for each presentation:

Trimming Indexes Getting Your Database In Shape

Indexes are a wonderful thing.  We should be using them, and we should be maintaining them.  But over time our production databases start to look a little pudgy around the mid-section.  Maybe they are a little bloated with Unused Indexes, maybe they have Duplicate Indexes, and possibly even Reverse Indexes.  The first step to fixing these problems it so see if you have them, and if you do the second is to set about fixing them. You could be costing yourself CPU cycles, I/Op’s, and space and never even know it.

Slide Deck, Demos

Transparent Data Encryption Inside and Out in SQL 2012

Security is a very important part of your job and in how data is utilized.  We have many tools to make data more secure, and starting in SQL 2008 we were able to add Transparent Data Encryption to that list.  Find out What it does and What it doesn’t do, How it effects Read-Only Filegroups, Performance, Compression (Backup and Row/Page), What the X.509 Encryption Standard is and Why you should be careful of what you store and where, and other Advance Features as well as some tips on how to manage it.

Slide Deck, Demos

Page & Row Compression Deep Dive with SQL Server 2012

Page and Row Compression are powerful new tools. Page & Row with SQL 2008 RTM, and Page & Row with Unicode Compression with SQL 2008 R2, and Spatial Types in SQL 2012.  We can turn it on, we can turn it off, but we want more!  What are Access Methods and how in the SQL Engine do they affect Compression?  What are the “Gotchas” of Page Compression?  How does Compression differ in the way it treats Non-Leaf & Leaf Level pages?  What additional functionality did we get in DBCC Page, DMV’s, Perfmon Counters, and Extended Events to support our usage of Compression?  How do complex query plans affect Compression?  Come find out!

Slide Deck, Demos

LUNCH!

That’s not all, on top of having 3 great sessions to choose from if you’re still not sick of me we’ve got a speaker round table on Wednesday where I’ll be hosting a table on SQL Server 2012 and new features.  While I may not have presented on them there are a lot of great 2012 topics like Columnstore Indexes, Always On Availability Groups, Always On Clustering Improvements, and more that we could chat about.

Great SQL People like MVP’s Jen Stirrup(@JenStirrup | blog), Grant Fritchey (@GFritchey | blog), Allen White (@SQLRunr | Blog),  Thomas Larock (@SQLRockstar | Blog), and William Pearson (@Bill_Pearson) will be there hosting different tables as well!

WRAP IT UP

Okay with that being said, it should be a fun filled week of SQL Learning.  There will be some wonderful night time activities as part of the conference as well. 

  I won’t make it to all of them, Wednesday night is the baby’s Christmas play at her day care can’t miss that!  For the rest of the week though I look forward to getting to see you all.

If you are in town I hope you get to stop by and say “Hi BALLS!”, and have a great time!

Thanks,

Brad

PASS DBA Virtual Chapter Trimming Indexes, Getting Your Database in Shape

Hello Dear Reader!  Tomorrow at 12 noon eastern I’ll be presenting for the PASS DBA Virtual chapter, click here to sign up for the meeting.

If you aren’t a member of/or familiar with PASS it is the ProfessionalAssociation for SQL Server.  PASS put’s together great things for us throughout the year like SQL Saturdays, which are put together by local PASS User Groups (click here to find the one in your area) groups that meet FREE monthly and have presentations on different SQL topics, The PASS Summit (Largest SQL Server conference in the world!), 24 Hours of PASS (free 12 spans of great training), and the PASS Virtual Chapters.  Virtual Chapters range 16 different subjects and 3 different languages, soon to be four different languages!

Joining PASS doesn’t cost you a dime, and I don’t get a penny for it, but it opens the door to a large amount of free technical content and training.  If you are not familiar I’d encourage you to click on the above links and become familiar with PASS today!

“So Balls”, you say, “What is this presentation you’re doing?”

Glad you asked Dear Reader!  I’m presenting for the DBA Virtual Chapter, 1 of the 16, and my subject is Trimming Indexes, Getting Your Database in Shape.

I’LL TAKE THE #2 SUPER SIZED

Here’s the abstract and then we’ll talk a little more:

“Indexes are a wonderful thing. We should be using them, and we should be maintaining them. But over time our production databases start to look a little pudgy around the mid-section. Maybe they are a little bloated with Unused Indexes, maybe they have Duplicate Indexes, and possibly even Reverse Indexes. The first step to fixing these problems it so see if you have them and if you do the second is to set about fixing them. You could be costing yourself CPU cycles, I/Op's, and space and never even know it.”

If you’ve been a DBA for a while you will inevitably inherit a system where you find indexes being used in less than optimal ways.  A lot of this is created by turn over in a company, going with all of the suggestions from DTA (Database Tuning Advisor), or having too many cooks in the kitchen.

It is possible to get things like Reverse Indexes, Duplicate Indexes, and unused Indexes.  You may be asking,  “What do those terms mean?  What secret ninja SQL Language are you speaking?  I know Clustered and Non-Clustered, but what-in-the-sam-hell is a REVERSE index!?”

It’s alright Dear Reader, no new secret terms.  A Duplicate index is just an Index where the physical structure exists more than once on a table.  Take the following Table:

CREATE TABLE Students(

          studentID int identity(1,1) primary key clustered

          ,ssn char(9)

          ,firstName varchar(50)

          ,middleInitial char(1)

          ,lastName varchar(100)

          ,gender char(1)

          )

If we created a Non-Clustered Index on the SSN column and we called it nclx_Students_SSN, and then someone else made a Non-Clustered Index on the SSN column and called it nclx_Students_SSN2 we would have a duplicated index.

“But Balls”, you say, “I would never do that!”

Of course not, you wouldn’t ever do that on purpose.   As code gets migrated from Dev to Production perhaps the Developer or Jr DBA adds an index that they didn’t realize you already has in place.  Or maybe you get a query plan with a “Missing Index hint” in Dev, only that index had been created as an urgent Production change, and never got implemented in Dev.  Migration comes around and as long as the names are different, WHAMO, you have two Non-Clustered Indexes on your SSN Column.

This example might not seem that bad, but imagine a 50 row table with a duplicate Non-Clustered Index on 5 rows, 10 rows, or 15 rows.  That’s a lot of extra data having to be persisted to disk and maintained.

"I wish my abs..I mean... databases where in shape"

Using the previous table let’s know make a Reverse Index.  We’ll create a Covering Non-Clustered index for a stored procedure that requires the SSN, FirstName, and LastName fields.  Some farther down the road you’ve left that company and a new developer is writing a different block of code and a different stored procedure and they create their Non-Clustered Index on LastName, FirstName, and SSN.

Then you have Unused Indexes.  These are the indexes that it seemed like a good idea to build, but nobody is using them.  In some places you have code that gets retired, but we still need the database structures,  in the Data Modeling phase Indexes were designed that were not used, or Database Tuning Advisor recommended it and it just wasn’t used.

Finding these are important because we are maintaining them, but the slackers do not contribute to our query performance. 

WRAP IT UP

So our goal for the hour will be to discuss Indexes make sure that we have a good foundation in them and what they store so we can understand why these 3 types of indexes are bad, and then use some scripts and DMV’s to identify them.

I'm also doing this presentation in a much longer format for SQL Live 360 in December of this year, as well as a couple more presentations.  Click on this link to check out Live 360!

I hope you’ll get a chance to stop by and join us!

Thanks Again,

Brad