<?xml version='1.0' encoding='UTF-8'?><?xml-stylesheet href="http://www.blogger.com/styles/atom.css" type="text/css"?><feed xmlns='http://www.w3.org/2005/Atom' xmlns:openSearch='http://a9.com/-/spec/opensearchrss/1.0/' xmlns:georss='http://www.georss.org/georss' xmlns:gd='http://schemas.google.com/g/2005' xmlns:thr='http://purl.org/syndication/thread/1.0'><id>tag:blogger.com,1999:blog-2878888158072252134</id><updated>2011-08-13T03:11:26.889-07:00</updated><category term='Enterprise Monitor'/><category term='Tuning'/><category term='MySQL Proxy'/><category term='MySQL Enterprise'/><category term='MySQL Enterprise Monitor'/><category term='SQL'/><category term='MySQL Query Analyzer'/><category term='Mark Callaghan'/><title type='text'>The Open Product Manager</title><subtitle type='html'>Open discussions on MySQL and the various swimmers in the MySQL Ecosystem.</subtitle><link rel='http://schemas.google.com/g/2005#feed' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/posts/default'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default?max-results=100'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/'/><link rel='hub' href='http://pubsubhubbub.appspot.com/'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><generator version='7.00' uri='http://www.blogger.com'>Blogger</generator><openSearch:totalResults>13</openSearch:totalResults><openSearch:startIndex>1</openSearch:startIndex><openSearch:itemsPerPage>100</openSearch:itemsPerPage><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-8852353313896691349</id><published>2010-01-22T12:12:00.000-08:00</published><updated>2010-01-22T12:28:42.228-08:00</updated><title type='text'>5.1 + new InnoDB Plugin</title><content type='html'>If you're wondering what MySQL 5.1 with the new InnoDB Plugin is all about you'll want to tune into the &lt;a href="http://mysql.com/news-and-events/web-seminars/display-493.html"&gt;webinar&lt;/a&gt; I am hosting next Tuesday.  I'll cover the why, what and how behind the immediate performance and scale improvements that can be had, especially on modern (&gt; 4 CPU) servers, by enabling the new plugin in MySQL 5.1.  &lt;a href="http://mysql.com/news-and-events/web-seminars/display-493.html"&gt;Learn more and get registered&lt;/a&gt;, it should be good time!&lt;br /&gt;&lt;br /&gt;You can also take it to a deeper level by joining Brian Miezejewski from our PS team on 3/9 for &lt;a href="http://mysql.com/news-and-events/web-seminars/display-498.html"&gt;a practical guide to using and tuning the new plugin features&lt;/a&gt; to improve performance and scale.  Hope you can join us!&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-8852353313896691349?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/8852353313896691349/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=8852353313896691349' title='1 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/8852353313896691349'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/8852353313896691349'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2010/01/51-new-innodb-plugin.html' title='5.1 + new InnoDB Plugin'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><thr:total>1</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-1215275135778143635</id><published>2010-01-14T08:41:00.000-08:00</published><updated>2010-01-14T08:47:03.821-08:00</updated><title type='text'>One reason a no indexes approach is nice</title><content type='html'>Like a lot of you, I’ve been following with interest &lt;a href="http://www.mysqlperformanceblog.com/2010/01/07/star-schema-bechmark-infobright-infinidb-and-luciddb/"&gt;Percona’s testing of the open source column databases.&lt;/a&gt; One thing I think is pretty cool about some column databases that work with MySQL is that they don’t require you to create indexes. The reason is, in general, the column is the index. Not having to create indexes is nice because lots of indexes can really bog down a database if you’ve got a lot of load or DML activities because the indexes have to be maintained for all data input and alterations.&lt;br /&gt;&lt;br /&gt;In Percona’s test, they showed the load time for all the different databases, but I noticed that the times didn’t include the index creation for LucidDB or MonetDB. I decided to follow &lt;a href="http://www.percona.com/docs/wiki/benchmark:ssb:luciddb:start"&gt;Vadim’s link on the LucidDB index creation&lt;/a&gt; and totaled up the time it took to create the indexes. For the index and statistics times, it was 384,314 seconds and when you add that to the 140,736 seconds for the table load, you get 6 days just to create the database. That’s quite a difference from the 6 hours for InfiniDB and 14 hours for InfoBright, both of which don’t need or use indexes.&lt;br /&gt;&lt;br /&gt;I’m sure indexes supply a benefit for some column DB’s in various use cases, but if the database was real dynamic and required a lot of new objects with indexes be added, continuous heavy loads, or DML, it would seem that indexes could really put a ding in things. In that case, it would seem column DB’s thatdon’t require indexes could have an edge there.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-1215275135778143635?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/1215275135778143635/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=1215275135778143635' title='8 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/1215275135778143635'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/1215275135778143635'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2010/01/one-reason-no-indexes-approach-is-nice.html' title='One reason a no indexes approach is nice'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><thr:total>8</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-2644943906405885676</id><published>2009-09-09T07:03:00.000-07:00</published><updated>2009-09-09T08:22:31.193-07:00</updated><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Query Analyzer'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise Monitor'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise'/><title type='text'>Less time finding, more time fixing!  Enterprise Monitor 2.1, Updated Query Analyzer Now GA!</title><content type='html'>I just wanted to tip my hat to the MySQL Enterprise Tools Engineering team for another great release of the Enterprise Monitor.  Not to name names, but I want to give a special thanks to a team that always over delivers on a collective commitment to producing quality software.  So, a mega thanks to:&lt;br /&gt;&lt;br /&gt;Andy Bang, Sloan Childers, Darren Oldag, Eric Herman, Jan Kneschke, Kay Roepke, Mark Matthews, Bill Weber, Diego Medina, Marcos Palacios, Carsten "Pino" Segieth, Josh Sled, Keith Russell, Mark Leith, Heidi Bergh-Hoff, and Gary Whizin (and also welcome Michael Schuster!)&lt;br /&gt;&lt;br /&gt;Yet another great job guys!&lt;br /&gt;&lt;br /&gt;The new version, 2.1, was posted as GA early on Tuesday and it is quite possibly the best release of the Enterprise Monitor to date.&lt;br /&gt;&lt;br /&gt;For those not familiar with the Enterprise Monitor, it is included in a &lt;a href="http://www.mysql.com/products/enterprise/"&gt;MySQL Enterprise subscription&lt;/a&gt; and  is a distributed web-based app that users deploy in their environment to monitor and tune the security, performance and availability of their dev, QA and production MySQL servers.  It is comprised of :&lt;br /&gt;&lt;br /&gt;&lt;ul&gt;&lt;li&gt;An agent, written in C, that is installed on each monitored data source, which collects MySQL and OS metrics, SQL code and exec results&lt;/li&gt;&lt;li&gt;A central server (aka "service manager"), written in Java, that collects, monitors and alerts on the data collected by each agent.  The service manager uses MySQL Best Practice Advisors to measure the collected data against user-defined thresholds and to proactively notify DBAs of problems or tuning opportunities.  Alerts are  sent to a central console or via SMTP or SNMP notifications.&lt;/li&gt;&lt;li&gt;A repository that holds the data collected by each agent.  The service manager monitors the data stored in repository vs maintaining a persistent connection to each MySQL server.&lt;a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_1YxiEYmBQYI/SqfEytMQM5I/AAAAAAAAABc/Mhjw7RrNJwQ/s1600-h/MEM21_dashboard_full1.png"&gt;&lt;img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer; width: 317px; height: 249px;" src="http://4.bp.blogspot.com/_1YxiEYmBQYI/SqfEytMQM5I/AAAAAAAAABc/Mhjw7RrNJwQ/s400/MEM21_dashboard_full1.png" alt="" id="BLOGGER_PHOTO_ID_5379484655320839058" border="0" /&gt;&lt;/a&gt;&lt;/li&gt;&lt;/ul&gt;The Enterprise Monitor also provides MySQL specific monitoring features.  There is a Replication Monitor that proactively monitors replication topologies for synch and performance issues and a new Query Analyzer that made its debut in release 2.0 in late 2008.   The Query Analyzer is designed to save DBAs/Devs time in finding the most expensive queries (by total exec time, exec count, amount of data returned, etc) running across all dev, QA and prod MySQL servers without any dependence on the MySQL logs or things like SHOW PROCESSLIST.  You can learn more about the Query Analyzer &lt;a href="http://www.mysql.com/products/enterprise/query.html"&gt;here&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;Based on customer interviews and years spent in the field, we understand the pain associated with finding bottlenecks rooted in poorly written or inefficient SQL code (this is consistently the #1 problem we hear when talking with MySQL DBAs and devs.)  This new release helps a DBA/Dev spend less time "finding" and more time "fixing" poorly performing queries.  The key new features in the Query Analyzer include:&lt;br /&gt;&lt;br /&gt;&lt;ul&gt;&lt;li&gt;Clickable MySQL and OS graphs that visual  correlation  system and query activity.  Mouse-over a spike in any graph and drill into the queries that were running at the same time. Big time saver.&lt;a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_1YxiEYmBQYI/SqfDnHK_N4I/AAAAAAAAABM/-WsTy70YVXs/s1600-h/MEM21_quan_by_server_cropped.png"&gt;&lt;img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer; width: 288px; height: 164px;" src="http://1.bp.blogspot.com/_1YxiEYmBQYI/SqfDnHK_N4I/AAAAAAAAABM/-WsTy70YVXs/s400/MEM21_quan_by_server_cropped.png" alt="" id="BLOGGER_PHOTO_ID_5379483356624795522" border="0" /&gt;&lt;/a&gt;&lt;/li&gt;&lt;li&gt;Drill down capability for  query specific executions – drill into any query and see execution specific graphs for exec time, count, data returned.  Helps you see the "normal" exec pattern for a query and identify outliers that may occur during specific windows or time or for specific variable combinations.&lt;/li&gt;&lt;li&gt;Counts for SQL errors/warnings - help you quickly identify queries that may have never finished or that finished in error.  These routinely go undetected by the MySQL logs, etc.&lt;/li&gt;&lt;li&gt;UI support for EXPLAIN generation threshold - gone are the days of hacking the quan.lua script to set this value!&lt;/li&gt;&lt;/ul&gt;We have also added new Advisor Rules and Graphs around connections, stale table statistics, tables without indexes, PKS and locked and long running processes.&lt;br /&gt;&lt;br /&gt;The new release also includes an updated "What's New" page that allows you to optionally subscribe to live feeds for your open support issues (nice, especially for the issues with a status of "waiting on customer") and for MySQL product updates and alerts.  Nice time saver, especially for getting updates on new releases of the Enterprise Server and for Monitor Advisors and graphs.&lt;a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_1YxiEYmBQYI/SqfECyeNlGI/AAAAAAAAABU/bkBMSedZOG0/s1600-h/MEM21_whatsnew_page_detail.png"&gt;&lt;img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer; width: 345px; height: 210px;" src="http://2.bp.blogspot.com/_1YxiEYmBQYI/SqfECyeNlGI/AAAAAAAAABU/bkBMSedZOG0/s400/MEM21_whatsnew_page_detail.png" alt="" id="BLOGGER_PHOTO_ID_5379483832104621154" border="0" /&gt;&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;So how do you get it?  Glad you asked...if you are an Enterprise subscriber you can grab the new release and all of the updated docs from the Enterprise Customer &lt;a href="https://enterprise.mysql.com/monitoring/download.php"&gt;download page&lt;/a&gt;.  If you are interested in learning more or want to try the new Monitor and Query Analyzer for yourself, you can register for a &lt;a href="http://mysql.com/trials/"&gt;30 day trial&lt;/a&gt; subscription which includes a fully functioning version of the Monitor and Query Analyzer.  You also learn everything about MySQL Enterprise by visiting the &lt;a href="http://www.mysql.com/products/enterprise/"&gt;MySQL web site&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;Look forward to hearing about your experience with the new release!&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-2644943906405885676?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/2644943906405885676/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=2644943906405885676' title='5 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/2644943906405885676'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/2644943906405885676'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2009/09/less-time-finding-more-time-fixing.html' title='Less time finding, more time fixing!  Enterprise Monitor 2.1, Updated Query Analyzer Now GA!'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media='http://search.yahoo.com/mrss/' url='http://4.bp.blogspot.com/_1YxiEYmBQYI/SqfEytMQM5I/AAAAAAAAABc/Mhjw7RrNJwQ/s72-c/MEM21_dashboard_full1.png' height='72' width='72'/><thr:total>5</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-2174286712614572477</id><published>2009-09-01T12:45:00.000-07:00</published><updated>2009-09-01T13:01:40.214-07:00</updated><title type='text'>Update on MySQL Enterprise Monitor and "Quan"</title><content type='html'>Just a quick update that the new MySQL Enterprise Monitor has reached RC readiness and is set for official launch in the next few weeks.  This is version 2.1 and features:&lt;br /&gt;&lt;ul&gt;&lt;li&gt;Enhanced Query Analyzer with correlation graphs so you can highlight and drill into spikes in key system resources to see the queries that were running at the same time&lt;/li&gt;&lt;li&gt;Query specific execution graphs so you can track the "normal" behavior of your queries over time&lt;/li&gt;&lt;li&gt;GUI support for Query Analyzer EXPLAIN generation&lt;br /&gt;&lt;/li&gt;&lt;li&gt;Live feeds for MySQL product updates and alerts&lt;/li&gt;&lt;li&gt;Live feeds for your open support issues&lt;/li&gt;&lt;li&gt;New Advisor Rules and Graphs&lt;/li&gt;&lt;li&gt;and some other things...&lt;/li&gt;&lt;/ul&gt;Here's a screenshot of the Query Analyzer and correlation graphs...&lt;br /&gt;&lt;br /&gt;&lt;a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_1YxiEYmBQYI/Sp18s7dokuI/AAAAAAAAAA8/LAzVM3Lg_q0/s1600-h/MEM21_quan_by_server_cropped.png"&gt;&lt;img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer; width: 442px; height: 255px;" src="http://3.bp.blogspot.com/_1YxiEYmBQYI/Sp18s7dokuI/AAAAAAAAAA8/LAzVM3Lg_q0/s400/MEM21_quan_by_server_cropped.png" alt="" id="BLOGGER_PHOTO_ID_5376590641468314338" border="0" /&gt;&lt;/a&gt;&lt;br /&gt;Enterprise subscribers can grab the RC &lt;a href="https://enterprise.mysql.com/monitoring/prerelease.php"&gt; here&lt;/a&gt;.  If you aren't a subscriber but want to try it for yourself, you can get it &lt;a href="http://mysql.com/trials/"&gt;here&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;Look for the official announcement on GA availability early next week.  Another great job by the MySQL Enterprise Tools Engineering team!&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-2174286712614572477?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/2174286712614572477/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=2174286712614572477' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/2174286712614572477'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/2174286712614572477'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2009/09/update-on-mysql-enterprise-monitor-and.html' title='Update on MySQL Enterprise Monitor and &quot;Quan&quot;'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media='http://search.yahoo.com/mrss/' url='http://3.bp.blogspot.com/_1YxiEYmBQYI/Sp18s7dokuI/AAAAAAAAAA8/LAzVM3Lg_q0/s72-c/MEM21_quan_by_server_cropped.png' height='72' width='72'/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-2968538827557393624</id><published>2008-09-03T10:52:00.000-07:00</published><updated>2008-09-03T11:23:18.901-07:00</updated><title type='text'>MySQL Query Analyzer: Quick Update</title><content type='html'>As expected, many people are interested in the "what" behind our new Enterprise Monitor 2.0 w/Query Analyzer, and again, as expected more than a fair number are asking "OK, so when can we try it?"   With that in mind, here is a quick update on where things stand:&lt;br /&gt;&lt;br /&gt;- MySQL Enterprise subscribers can download build 7038 (soon to be 704x) and all of the docs from the &lt;a href="https://enterprise.mysql.com/"&gt;MySQL Enterprise customer site&lt;/a&gt;.  It has been a popular download and we should have a refreshed build very soon.&lt;br /&gt;&lt;br /&gt;- We are planning to post a public beta in the next 2-3 weeks, most likely after we (the Enterprise Tools engineering team) all return from our annual Engineering meeting (this year it is in Riga, Latvia).  That event wraps up on 9/24.&lt;br /&gt;&lt;br /&gt;- I am doing a webcast on Query Analyzer for our friends in EMEA tomorrow.  You can learn more and get registered &lt;a href="http://mysql.com/news-and-events/web-seminars/display-194.html"&gt;here.&lt;/a&gt;  I did the same presentation in the US back on 8/20, so if you can't make the live event, the 8/20 recording/demo is &lt;a href="http://mysql.com/news-and-events/on-demand-webinars/display-od-181.html"&gt;here&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;As the public beta kicks into gear I am interested in hearing your feedback on the Enterprise Monitor 2.0, especially the new Query Analyzer.  Please plan to actively participate by using our public discussion &lt;a href="http://forums.mysql.com/index.php?137"&gt;forums&lt;/a&gt; (feel free to start posting now!)  In advance of the public beta I would love to get your feedback on the Monitor/Advisors and how we can improve things to better fit your needs.  The forums are open and your honest feedback is greatly appreciated.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-2968538827557393624?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/2968538827557393624/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=2968538827557393624' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/2968538827557393624'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/2968538827557393624'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2008/09/mysql-query-analyzer-quick-update.html' title='MySQL Query Analyzer: Quick Update'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-2782152769092454830</id><published>2008-08-28T14:55:00.000-07:00</published><updated>2008-08-28T17:21:48.198-07:00</updated><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Proxy'/><category scheme='http://www.blogger.com/atom/ns#' term='Mark Callaghan'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Query Analyzer'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise Monitor'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise'/><title type='text'>MySQL Query Analyzer: Tracking query executions</title><content type='html'>From a performance standpoint, sometimes even tightly tuned queries can cause a performance drag.  The common problem here is not one of actual query performance, rather it is a function of:&lt;br /&gt;&lt;br /&gt;- the velocity and frequency that a query is submiited for execution&lt;br /&gt;- the total execution time of the aggregated executions&lt;br /&gt;&lt;br /&gt;This could be symptomatic of an application not properly configured for caching (see Darren Oldag's &lt;a href="http://darren.oldag.net/2008/06/hibernate-cache-queries-natural-id-way.html"&gt;blog&lt;/a&gt; on this!), or just overall poor design.  Regardless of why, when or how we all know it happens.  The trouble with this particular problem is that when a query is tuned, or very simple, it is usually not suspect for being a resource hog.   Pulling aggregates for number of execs and total exec time for specific queries is a little tricky and labor intensive with the Slow Query Log, and not really a good option for SHOW PROCESSLIST.  With this in mind, we designed the Query Analyzer to aggregate these values for quick reference in the Enterprise Monitor.  Take a look:&lt;br /&gt;&lt;br /&gt;&lt;a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_1YxiEYmBQYI/SLdAZNLGnHI/AAAAAAAAAA0/iWlXuyJ5pdg/s1600-h/execdetails.jpg"&gt;&lt;img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="http://4.bp.blogspot.com/_1YxiEYmBQYI/SLdAZNLGnHI/AAAAAAAAAA0/iWlXuyJ5pdg/s400/execdetails.jpg" alt="" id="BLOGGER_PHOTO_ID_5239727493246000242" border="0" /&gt;&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;We have also been listening when &lt;a href="http://mysqlha.blogspot.com/2008/07/top-n-monitoring.html"&gt;Mark Callaghan&lt;/a&gt; talks about reporting rollups for the top-N objects that are consuming resources on the server.  Given we will probably have to wait until 6.0 to get the SHOW STATS extensions for this, we are looking at creative ways we can do this now using the proxy and Monitor service agent.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-2782152769092454830?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/2782152769092454830/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=2782152769092454830' title='10 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/2782152769092454830'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/2782152769092454830'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2008/08/mysql-query-analyzer-tracking-query.html' title='MySQL Query Analyzer: Tracking query executions'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media='http://search.yahoo.com/mrss/' url='http://4.bp.blogspot.com/_1YxiEYmBQYI/SLdAZNLGnHI/AAAAAAAAAA0/iWlXuyJ5pdg/s72-c/execdetails.jpg' height='72' width='72'/><thr:total>10</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-3339451847252947866</id><published>2008-08-25T12:48:00.000-07:00</published><updated>2008-08-25T17:27:55.723-07:00</updated><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Proxy'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Query Analyzer'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise Monitor'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise'/><title type='text'>MySQL Query Analyzer: DBA Task #1: Finding Bad Queries</title><content type='html'>One of the biggest problems I faced as a field DBA was defending my production databases against poorly performing SQL code.  Talking to folks at the MySQL UC, during customer visits and trolling the MySQL forums/blogs confirms that this is a common problem and even more challenging when a performance problem pops up during times when no code promotions have taken place.&lt;br /&gt;&lt;br /&gt;&lt;span style="font-weight: bold; font-style: italic;"&gt;Traditional/popular way of finding bad SQL code&lt;/span&gt;&lt;br /&gt;For MySQL DBAs the challenge to identify and isolate resource intensive SQL code is really two-fold; job #1 is to find the offending code (after that the chore becomes fixing it so it performs, but that is a topic for another post).  Most MySQL DBAs have used the MySQL Slow Query Log ("SQ Log") at some point to help with job #1.  For those not familiar, the SQ Log is enabled by starting MySQL with --log-slow-queries[=file_name] option.  Once enabled the SQ Log captures queries that took longer than X seconds (user definable value between 1 and 10) and presents them for parsing and analysis.  Beginning in 5.0 it can be configured to also log any queries that do not use indexes.  The SQ Log is formatted into entries that look like:&lt;br /&gt;&lt;br /&gt;&lt;p:colorscheme colors="#ffffff,#000000,#808080,#000000,#00cc99,#3333cc,#ccccff,#b2b2b2"&gt;  &lt;/p:colorscheme&gt;&lt;div shape="_x0000_s1026" class="O"&gt;  &lt;div style=""&gt;&lt;span style=""&gt;&lt;b&gt;#Time: 08073101 16:25:24 &lt;/b&gt;&lt;/span&gt;&lt;/div&gt;  &lt;div style=""&gt;&lt;span style=""&gt;&lt;b&gt;#User@Host: root[root] @ localhost [127.0.0.1] &lt;/b&gt;&lt;/span&gt;&lt;/div&gt;  &lt;div style=""&gt;&lt;span style=""&gt;&lt;b&gt;#Query_time: 8 Lock_time: 0 Rows_sent: 20 Rows_examined: 243661 &lt;/b&gt;&lt;/span&gt;&lt;/div&gt;  &lt;div style=""&gt;&lt;span style=""&gt;&lt;b&gt;SELECT part_num FROM `inventory`.`parts` WHERE &lt;/b&gt;&lt;/span&gt;&lt;/div&gt;  &lt;div style=""&gt;&lt;span style=""&gt;&lt;b&gt;(`ven` = "foo") ORDER BY `delivery_datetime` DESC LIMIT 100;&lt;/b&gt;&lt;/span&gt;&lt;span style="font-family:Arial;"&gt;&lt;b&gt; &lt;/b&gt;&lt;/span&gt;&lt;/div&gt;    &lt;/div&gt;&lt;br /&gt;While the SQ Log provides good details on bad code, using it comes at a cost:&lt;br /&gt;- Prior to 5.1, MySQL has to be restarted to enable logging&lt;br /&gt;- The log grows very large, very quickly.  Running it in production is not mainstream, but can be managed via scripts and FLUSH LOGS&lt;br /&gt;- Entries must be parsed/sorted for relevance&lt;br /&gt;- Must use long_query_time=0 option to capture all queries, which comes with overhead of its own&lt;br /&gt;- Statements are logged in raw format, there is no aggregation, or roll ups of executions times, occurrences, etc.  Basically, the SQ Log is not easy to use, and takes time to navigate to find queries that are suspect and in need of tuning or elimination.&lt;br /&gt;&lt;br /&gt;At this point, I have to admit that I &lt;span style="font-style: italic;"&gt;*strongly*&lt;/span&gt; agree with those that say that MySQL performance related metrics should be part of the MySQL server and readily available for all to consume.  In short, things like the SQ Log are good, but such instrumentation belongs in a true performance/wait interface that is designed into the MySQL server product.   My buddy &lt;a href="http://blogs.mysql.com/robin/"&gt;Robin Schumacher &lt;/a&gt;has been promoting such an Engineering spec for many moons and it appears we will see the first fruits of that work appear in 6.0.  So while we are waiting we have a choice; we can continue to pine for a server side solution, or we can be proactive and create an easy to use solution that works now and will be valid for our older MySQL servers.  MySQL Proxy to the rescue...&lt;br /&gt;&lt;br /&gt;&lt;span style="font-weight: bold; font-style: italic;"&gt;Using MySQL Proxy for Monitoring Queries/Performance&lt;/span&gt;&lt;br /&gt;The MySQL Proxy is available under the GPL and provides a chassis for those who want to build advanced MySQL query and performance monitoring solutions.   By implementing the  Proxy between your apps and MySQL servers you can intercept their communication stream and build your own query and performance related data collections using Lua and then use your own custom apps to aggregate, monitor and view the data as it runs on your systems.   Info (and user forums) on using the Proxy is &lt;a href="http://dev.mysql.com/doc/refman/5.1/en/mysql-proxy.html"&gt;here&lt;/a&gt;&lt;a href="http://dev.mysql.com/doc/refman/5.1/en/mysql-proxy.html"&gt;.&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;&lt;br /&gt;&lt;span style="font-weight: bold; font-style: italic;"&gt;Using MySQL's Query Analyzer to find bad SQL code&lt;/span&gt;&lt;br /&gt;MySQL Enterprise provides an out-of-the-box solution for DBAs/Devs who want to use the Proxy to monitor for poorly performing SQL code, but who don't have the time to build a solution on their own.  The Enterprise Monitor Service Agent has been extended to include the Proxy chassis and required Lua extensions so that it listens on a user defined port for application queries, collects the SQL code and performance stats and then reports the results back so they can be stored in the Monitor repository for monitoring and analysis.    Integrated into the Enterprise Monitor, the Query Analyzer leverages the Proxy reported metrics so DBAs and Devs can visually pinpoint bad SQL code based on aggregated exec times, number of execs, rows/data returned, etc.  The cool thing is the Query Analyzer saves development time building a custom monitoring solution.  It also eliminates all of the human and system overhead attributed with enabling and parsing the SQ Log.   The Query Analyzer:&lt;br /&gt;&lt;br /&gt;- minimizes/eliminates the need to enable the SQ Log to find expensive SQL code&lt;br /&gt;- aggregates queries by total exec time, number of executions&lt;br /&gt;- organizes and sorts SQL by relevance across all servers&lt;br /&gt;- filters by query type, content&lt;br /&gt;- shows trending by date range&lt;br /&gt;- tracks queries by database, application&lt;br /&gt;- provides drill downs into normalized and specific execution statistics&lt;br /&gt;- provides full explain of worst offenders (user definable)&lt;br /&gt;- provides summary of all queries in a consolidated view:&lt;br /&gt;&lt;br /&gt;&lt;br /&gt;&lt;a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_1YxiEYmBQYI/SLMgSc6ji2I/AAAAAAAAAAk/3cIjultM8iE/s1600-h/summary.jpg"&gt;&lt;img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="http://2.bp.blogspot.com/_1YxiEYmBQYI/SLMgSc6ji2I/AAAAAAAAAAk/3cIjultM8iE/s400/summary.jpg" alt="" id="BLOGGER_PHOTO_ID_5238566292933544802" border="0" /&gt;&lt;/a&gt;&lt;br /&gt;After you find a suspect statement, you can then drill into specific occurs across servers:&lt;br /&gt;&lt;br /&gt;&lt;br /&gt;&lt;a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_1YxiEYmBQYI/SLMgvNSESyI/AAAAAAAAAAs/SPptanHvIaA/s1600-h/details.jpg"&gt;&lt;img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="http://2.bp.blogspot.com/_1YxiEYmBQYI/SLMgvNSESyI/AAAAAAAAAAs/SPptanHvIaA/s400/details.jpg" alt="" id="BLOGGER_PHOTO_ID_5238566786953399074" border="0" /&gt;&lt;/a&gt;&lt;br /&gt;While enabling the Query Analyzer comes with some Agent overhead expense, it can be quickly enabled/disabled without a server restart and the SQL code and performance data that is collected and returned is stored in the Monitor repository so it can used for later analysis.  For the SQ Log purists, we do plan to incorporate a means to pull over the MySQL log files into the Monitor too, but we wanted to implement a solution that helps our pre-5.1 install base (meaning, they can monitor for bad queries without enabling the SQ Log via a server re-start) as part of the first rev.  Hey, if we have to wait for a true performance/wait interface, may as well make the best use of our time...&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-3339451847252947866?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/3339451847252947866/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=3339451847252947866' title='1 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/3339451847252947866'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/3339451847252947866'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2008/08/mysql-query-analyzer-dba-task-1-finding.html' title='MySQL Query Analyzer: DBA Task #1: Finding Bad Queries'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media='http://search.yahoo.com/mrss/' url='http://2.bp.blogspot.com/_1YxiEYmBQYI/SLMgSc6ji2I/AAAAAAAAAAk/3cIjultM8iE/s72-c/summary.jpg' height='72' width='72'/><thr:total>1</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-692865489581874022</id><published>2008-08-14T13:55:00.000-07:00</published><updated>2008-08-14T14:37:21.051-07:00</updated><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Query Analyzer'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise Monitor'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise'/><title type='text'>MySQL Enterprise Monitor: Agent = Extensibility</title><content type='html'>I have gotten a few questions around my &lt;a href="http://theopenproductmanager.blogspot.com/2008/07/mysql-enterprise-monitor-secret-about.html"&gt;7/29 blog posting&lt;/a&gt; on agent vs client-side products and wanted to make it clear that our decision to go with a distributed agent architecture was a strategic decision that has paved the way for us to deliver on our overall "pain point" addressing roadmap.  True, building a client-side app would have meant a faster go-to-market delivery, but that path would have imposed serious limitations on our ability to address and alleviate common pain points around the use and scaling of apps on MySQL.&lt;br /&gt;&lt;br /&gt;So what does an agent really do for us from a strategic standpoint?  Without revealing too many details (well, these things have already been openly discussed with customers and presented in our MySQL UC 2008 Product roadmap session), our agent-based architecture allows us to provide:&lt;br /&gt;&lt;br /&gt;- Freedom from a fat client **&lt;br /&gt;- Minimal connections to the backend MySQL database **&lt;br /&gt;- Real-time visibility and monitoring of all MySQL servers in a consolidated view **&lt;br /&gt;- Real-time collection of queries and result sets **&lt;br /&gt;- Independent collection of MySQL, OS, SQL for monitoring, trending, capacity planning **&lt;br /&gt;- Slave aware Load Balancing of reads/writes&lt;br /&gt;- Connection concentration to remove overhead of idle connections from production servers&lt;br /&gt;- Autonomous, remote administration of all MySQL servers&lt;br /&gt;- Server level scheduling of admin tasks, maintenance, back up, recovery, etc.&lt;br /&gt;- Application data sharding across replicated slaves&lt;br /&gt;- Server/App level Security and Data Auditing&lt;br /&gt;&lt;br /&gt;Just to name a few.  As I said, there are no secrets here, we have discussed all of this openly in our public webinars and at this past Spring's UC.   For your day-to-day tasks, we do provide quality, client-side, &lt;a href="http://dev.mysql.com/downloads/gui-tools/5.0.html"&gt;GUI tools&lt;/a&gt; for *free* that will help you manage single servers, dev and test queries, migrate data, etc.   For the more advanced things noted above, the work is better left to a distributed management solution.&lt;br /&gt;&lt;br /&gt;As a reminder, look for the public beta of the Enterprise Monitor w/Query Analyzer to open up in the next few weeks.  I will post links to the beta registration and download when it is ready to roll.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-692865489581874022?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/692865489581874022/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=692865489581874022' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/692865489581874022'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/692865489581874022'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2008/08/mysql-enterprise-monitor-agent.html' title='MySQL Enterprise Monitor: Agent = Extensibility'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-1829176133598041137</id><published>2008-07-31T15:07:00.000-07:00</published><updated>2008-07-31T15:21:57.371-07:00</updated><category scheme='http://www.blogger.com/atom/ns#' term='Enterprise Monitor'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Query Analyzer'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise'/><title type='text'>MySQL Query Analyzer: Open Beta Coming!</title><content type='html'>We are quickly approaching opening up the MySQL Query Analyzer for general beta and I wanted to pass along an open invite to the following related and informational events.&lt;br /&gt;&lt;br /&gt;On 8/13, I will be doing a micro level presentation on MySQL Enterprise.  Please attend and learn more about the database software, monitoring and advisor services and support solutions that make up a subscription.  I plan to do a demo of the Enterprise Monitor and the new Query Analyzer; that alone makes attending worth the price of admission (in this case 45 minutes of your time!).   Learn more and register &lt;a href="http://mysql.com/news-and-events/web-seminars/display-179.html"&gt;here&lt;/a&gt;.&lt;br /&gt;&lt;br /&gt;On 8/20, I will be doing a presentation on the new Query Analyzer.  This will be a technical discussion around how DBAs monitor for bad queries now and how the Query Analyzer makes the job much easier.  This will be a good time to learn about getting in on the beta too.  Learn more and register &lt;a href="http://mysql.com/news-and-events/web-seminars/display-181.html"&gt;here.&lt;/a&gt;&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-1829176133598041137?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/1829176133598041137/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=1829176133598041137' title='1 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/1829176133598041137'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/1829176133598041137'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2008/07/mysql-query-analyzer-upcoming-events.html' title='MySQL Query Analyzer: Open Beta Coming!'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><thr:total>1</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-1359887662909965711</id><published>2008-07-29T15:21:00.000-07:00</published><updated>2008-07-30T06:29:06.954-07:00</updated><title type='text'>MySQL Enterprise Monitor: The Secret about Agents</title><content type='html'>I am often asked why we chose a distributed, web-based architecture for the Enterprise Monitor application.  For those not familiar with how the app is deployed, the Enterprise Monitor is typically installed within a customer firewall and is comprised of 3 components:&lt;br /&gt;&lt;br /&gt;- a lightweight agent written in C, that is deployed to each monitored server to collect MySQL, OS data and Query content and  diagnostics&lt;br /&gt;- a centralized server that monitors the collected data and queries, sends out alerts and serves up the supporting web application&lt;br /&gt;- a MySQL repository that holds the collected data and queries&lt;br /&gt;&lt;br /&gt;A typical deployment looks something like this:&lt;br /&gt;&lt;br /&gt;&lt;a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp0.blogger.com/_1YxiEYmBQYI/SI-bBcmCyoI/AAAAAAAAAAc/Ish6my-s7Uk/s1600-h/architecture.jpg"&gt;&lt;img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="http://bp0.blogger.com/_1YxiEYmBQYI/SI-bBcmCyoI/AAAAAAAAAAc/Ish6my-s7Uk/s400/architecture.jpg" alt="" id="BLOGGER_PHOTO_ID_5228568141558368898" border="0" /&gt;&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;Having come to MySQL from &lt;a href="http://embarcadero.com/"&gt;Embarcadero Technologies&lt;/a&gt;, I understand that many customers are somewhat uneasy with loading an agent on their production database servers.  In fact for environments with a small number of developers, applications, and databases I actually prefer a client-centric solution.  With this in mind I use the following guidelines when deciding if a new administration/monitoring product or app should be client or web-based (please note that these do NOT apply to development or design tools, which are best rendered in client side apps):&lt;br /&gt;&lt;br /&gt;Local, client-based apps are best for:&lt;br /&gt;- Small development shops (3 or less developers).  I want the available connections to my production servers to be paying customers not DBAs or Developers!&lt;br /&gt;- Small applications with a small number of MySQL servers.  Most client side apps provide single server connections and visibility making navigation a bit kludgy.  Some ISVs have the multi-server view thing figured out, but most do not.&lt;br /&gt;- Departmental applications with limited end users.  The SLAs tend to be less strict and network bandwidth issues around pulling data to/from dedicated client connections is less of an issue.&lt;br /&gt;- Small, localized corporate campuses.  Typically client based solutions require the footprint of the app to reside on a specific desktop, device, etc.  This requires the user to be somewhere close to an enabled workstation to well, uh, use the app.&lt;br /&gt;&lt;br /&gt;Distributed, web-base apps are best for:&lt;br /&gt;- Large shops with many DBAs, Developers, Sys Admins.  In most web-based deployments all app users can be serviced by a single connection and data collected by an agent that is running on the monitored data source.  Minimal connections, maximum efficiency.&lt;br /&gt;- Monitoring and managing a large number of backend MySQL servers.  This is made easy because typically an agent based architecture scales better than one that relies on adding more clients (and connections) to an environment.  Most deployed agents serve as "daemons" that keep track of things MySQL up/down status, connection status, etc, all without the user having to initiate a connection.&lt;br /&gt;- Monitoring MySQL from anywhere.  Basically all you need is access to a browser.  Enough said.&lt;br /&gt;&lt;br /&gt;So, why did we choose a web-based architecture for the Enterprise Monitor?  Well, it seems most of our users are split across these guidelines; most have small, nimble MySQL DBA and Dev teams, but an ever growing number of MySQL servers.  We opted to provide a tool that would help them scale their resources to monitor/manage more MySQL servers with less time and effort.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-1359887662909965711?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/1359887662909965711/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=1359887662909965711' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/1359887662909965711'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/1359887662909965711'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2008/07/mysql-enterprise-monitor-secret-about.html' title='MySQL Enterprise Monitor: The Secret about Agents'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media='http://search.yahoo.com/mrss/' url='http://bp0.blogger.com/_1YxiEYmBQYI/SI-bBcmCyoI/AAAAAAAAAAc/Ish6my-s7Uk/s72-c/architecture.jpg' height='72' width='72'/><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-8228655619769175117</id><published>2008-07-28T19:07:00.000-07:00</published><updated>2008-07-28T20:19:51.869-07:00</updated><category scheme='http://www.blogger.com/atom/ns#' term='Enterprise Monitor'/><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Enterprise'/><title type='text'>MySQL Enterprise Monitor: Competition is a good thing!</title><content type='html'>As the Product Manager for &lt;a href="http://mysql.com/products/enterprise/"&gt;MySQL Enterprise and the Enterprise Monitor&lt;/a&gt; I am constantly being asked questions from our Sales team, prospects, customers, etc. about how our products stack up against competing products.  This is tough for a PM because competitive situations change with each new release cycle and ISVs (both free/open and commercial) with agile development practices can deliver new features in very short order.  Further, getting into a feature-feature discussion is a no win situation because someone will ALWAYS have more check marks.  Also, I tend to be more positive about competing products because a) healthy competition makes us all better and b) my competitors enable more people to use MySQL to build apps that will most likely need MySQL support and c) the best support for MySQL comes under a MySQL Enterprise subscription!  With those things in mind you will *never* hear me or the Engineering team I work with bad mouth or otherwise run down a competing MySQL monitoring product. &lt;br /&gt;&lt;br /&gt;When asked about competing MySQL Monitoring products I think it is best to focus most on the value the Enterprise Monitor provides by asking some simple questions:&lt;br /&gt;&lt;br /&gt;- Does product X allow you to see and monitor all your servers in one consolidated view?&lt;br /&gt;- Is product X agent and web based for scalability?&lt;br /&gt;- Does product X use minimum connections to collect monitoring data from your MySQL servers?&lt;br /&gt;- Does product X store monitoring data so you can analyze it later using any BI app?&lt;br /&gt;- Does product X notify you of problems when you are not using the GUI?&lt;br /&gt;- Does product X describe and help you fix/tune what/where/how when needed?&lt;br /&gt;- Does product X plug into your existing notification/alert/escalation system?&lt;br /&gt;- Does product X show you the top-N query resource hogs for specified periods of time?&lt;br /&gt;- Finally, does product X come as part of solution that includes a version of MySQL fully supported with regular updates, and production support provided by the MySQL Support team for both the MySQL server and the monitoring product?&lt;br /&gt;&lt;br /&gt;Not sure about other Monitoring products, but the answers for the Enterprise Monitor are, in no certain order, yes yes, yes, yes, yes, yes, yes, yes and yes.&lt;br /&gt;&lt;br /&gt;I am also torn when I am asked to compare how the Enterprise Monitor compares to custom in-house written scripts used to monitor MySQL.  Knowing the blood, sweat, tears and pride that goes into each script I usually ask "how will you spend your time now that won't have to collect and store metric data and then write, version, or maintain your own scripts to monitor it?"  The former DBA in me recognizes when this particular question strikes a chord...&lt;br /&gt;&lt;br /&gt;-&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-8228655619769175117?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/8228655619769175117/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=8228655619769175117' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/8228655619769175117'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/8228655619769175117'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2008/07/mysql-enterprise-monitor-competition-is.html' title='MySQL Enterprise Monitor: Competition is a good thing!'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-4896028811081002118</id><published>2008-07-25T14:10:00.000-07:00</published><updated>2008-07-25T14:49:31.210-07:00</updated><category scheme='http://www.blogger.com/atom/ns#' term='MySQL Query Analyzer'/><category scheme='http://www.blogger.com/atom/ns#' term='SQL'/><category scheme='http://www.blogger.com/atom/ns#' term='Tuning'/><title type='text'>MySQL Query Analyzer: Finds good code, gone bad</title><content type='html'>In my 14 years in development I learned that outside of poor schema design, nothing drains the performance of an application more than poorly performing SQL code.  Even code that ran well on day one of production would sometimes come back to bite at the worst possible times.  Even worse, as a DBA I was consistently asked to bail out a development team that was either tuning their code before the rush to production or that was trying to finger code that had fallen victim to a dropped or changed index.  Never fun.&lt;br /&gt;&lt;br /&gt;As a Product Manager with MySQL I have learned from meeting with friends/customers that this experience hasn't really changed much since I left the field.  I hear things like:&lt;br /&gt;&lt;br /&gt;- MySQL is not well instrumented for tracking code level performance metrics&lt;br /&gt;- Logs are OK, but not centralized and too low-level for easy navigation&lt;br /&gt;- We need help identifying "good code gone bad" and "bad code gone worse"&lt;br /&gt;&lt;br /&gt;To these friends I say we have listened (and will continue to) and help is on the way!  My team has been busy working on the new MySQL Query Analyzer that will ship as part of the Enterprise Monitor a little later this year.  Just a few bullets on what it does and what you can do with it.&lt;br /&gt;&lt;br /&gt;Cool things it does:&lt;br /&gt;- Proactive collection and identification of problematic SQL code.&lt;br /&gt;- Historical browsing/analysis of queries across all servers.&lt;br /&gt;- Aggregated roll ups of all queries in canonical form (no variables).&lt;br /&gt;- Fully qualified views of worst performing statements.&lt;br /&gt;- Drill downs into query details, number of executions, execution stats&lt;br /&gt;&lt;br /&gt;These things are baked into the Monitor to help:&lt;br /&gt;- Tune your SQL code before it is promoted to production&lt;br /&gt;- Quickly identify queries that are sapping performance&lt;br /&gt;-- by query type, content, server or application user&lt;br /&gt;- Once problematic code is surfaced you can:&lt;br /&gt;-- view an EXPLAIN plan to see where you need indexes&lt;br /&gt;&lt;br /&gt;Here's a screenshot of the Monitor with Quan enabled:&lt;br /&gt;&lt;br /&gt;&lt;a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp1.blogger.com/_1YxiEYmBQYI/SIpIP2Oif1I/AAAAAAAAAAU/bj97wMQaWHI/s1600-h/querysummary.jpg"&gt;&lt;img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="http://bp1.blogger.com/_1YxiEYmBQYI/SIpIP2Oif1I/AAAAAAAAAAU/bj97wMQaWHI/s400/querysummary.jpg" alt="" id="BLOGGER_PHOTO_ID_5227069754608615250" border="0" /&gt;&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;We are currently working with a few "friendlies" on the first beta, but plan to open things for general beta soon.  Stay tuned (no pun intended...), more details to follow on how you can help with this.&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-4896028811081002118?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/4896028811081002118/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=4896028811081002118' title='4 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/4896028811081002118'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/4896028811081002118'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2008/07/mysql-query-analyzer-finds-good-code.html' title='MySQL Query Analyzer: Finds good code, gone bad'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><media:thumbnail xmlns:media='http://search.yahoo.com/mrss/' url='http://bp1.blogger.com/_1YxiEYmBQYI/SIpIP2Oif1I/AAAAAAAAAAU/bj97wMQaWHI/s72-c/querysummary.jpg' height='72' width='72'/><thr:total>4</thr:total></entry><entry><id>tag:blogger.com,1999:blog-2878888158072252134.post-7646049295178072136</id><published>2008-07-24T19:01:00.000-07:00</published><updated>2008-07-24T20:06:21.551-07:00</updated><title type='text'>To be completely open and honest...</title><content type='html'>I remember the day I got "the" call. It was in January, 2001 and I was working as a part of an engineering team developing an online, web-based customer billing system for Louisville Gas &amp;amp; Electric. The app was being developed using VB.net on a Windows DNA (distributed network app) architecture that would eventually be served up under IIS. Cutting edge stuff for the day, ancient by today's standards. The call came from my current boss, Robin Schumacher, who wanted me to join him in something call "Product Management" with &lt;a href="http://embarcadero.com/"&gt;Embarcadero Technologies&lt;/a&gt;. Overall the move has been a good one, but to be completely honest, I miss getting elbows deep in technical details. Along the way, I have had the opportunity to work with some of the best database management tools on the market. I was fortunate to manage Embarcadero's flagship Rapid SQL and DBArtisan products during my 4+ year tenure and had the great privilege of working with one of the highest performing engineering teams in the ISV business.&lt;br /&gt;&lt;br /&gt;Robin left Embarcadero to start the Product Management group at MySQL in June, 2005. He recruited me again and I joined him in December of 2005 to manage what was then call MySQL Network. Having worked primarily for corporate IT shops and commercial software companies, it was quite an adjustment coming to work for MySQL. Front and center, the primary product is open source and free to use; hard to swallow for the capitalist in me, but hey I quickly adapted. Actually, I prefer the MySQL model to the old school, licensed, proprietary model. Basically, you use our product to build great apps and when those apps become critical to your business, you pay us to help you make sure they are up and running great. Win-win!&lt;br /&gt;&lt;br /&gt;At MySQL I work with some of the best and brightest Engineering and business minds in the industry. My primary partnership is with the Enterprise Tools Engineering team led by Gary Whizin and Mark Matthews. Our primary work is focused on the MySQL Enterprise Monitor which comes as part of a MySQL Enterprise subscription. MySQL Enterprise is our subscription based solution that includes the Enterprise Server and regular bug fixes, the &lt;a href="http://mysql.com/products/enterprise/monitor.html"&gt;Enterprise Monitor and Expert Advisors&lt;/a&gt; and our stellar Production Support Services. You can learn more &lt;a href="http://mysql.com/products/enterprise/"&gt;here&lt;/a&gt;. We (PM and the Enterprise Tools team) release new versions of the Monitor 2-3 times a year to ensure that the product continues to evolve. Along these lines we are currently working on Enterprise Monitor 2.0 that will ship with advanced Query collection and analysis capabilities. Of all the product releases I have been involved with since jumping from development to Product Management, this one has me the most excited. It might be because we are addressing a common DBA/Developer pain point with a very real, easy to use solution. It might be because every single customer we have spoken to echoes this pain. It might be those things, but I think I am most excited because some of the proprietary tool vendors in the MySQL monitoring space have creatively adopted our very public facing roadmap and announced similar features in their products. I think this is great! We want them to be successful and to enable more people to adopt and deploy MySQL as part of their move to innovative Web 2.0 technologies. IMHO this is a win all the way around!&lt;br /&gt;&lt;br /&gt;I will post more details on the new beta release of the Enterprise Monitor with the new Query Analyzer in my upcoming posts. It is mighty cool!&lt;div class="blogger-post-footer"&gt;&lt;img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/2878888158072252134-7646049295178072136?l=theopenproductmanager.blogspot.com' alt='' /&gt;&lt;/div&gt;</content><link rel='replies' type='application/atom+xml' href='http://theopenproductmanager.blogspot.com/feeds/7646049295178072136/comments/default' title='Post Comments'/><link rel='replies' type='text/html' href='http://www.blogger.com/comment.g?blogID=2878888158072252134&amp;postID=7646049295178072136' title='0 Comments'/><link rel='edit' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/7646049295178072136'/><link rel='self' type='application/atom+xml' href='http://www.blogger.com/feeds/2878888158072252134/posts/default/7646049295178072136'/><link rel='alternate' type='text/html' href='http://theopenproductmanager.blogspot.com/2008/07/to-be-completely-open-and-honest.html' title='To be completely open and honest...'/><author><name>Rob Young</name><email>noreply@blogger.com</email><gd:image rel='http://schemas.google.com/g/2005#thumbnail' width='16' height='16' src='http://img2.blogblog.com/img/b16-rounded.gif'/></author><thr:total>0</thr:total></entry></feed>
