{"id":148,"date":"2015-10-07T12:38:34","date_gmt":"2015-10-07T16:38:34","guid":{"rendered":"https:\/\/secure.devconinc.com\/dci\/?page_id=148"},"modified":"2018-07-22T22:37:27","modified_gmt":"2018-07-23T02:37:27","slug":"case-study-victorias-secret-pink","status":"publish","type":"page","link":"https:\/\/www.devconinc.com\/dci\/case-study-victorias-secret-pink\/","title":{"rendered":"Victoria&#8217;s Secret Pink Nation"},"content":{"rendered":"<div id=\"cs-content\" class=\"cs-content\" >\n<div class=\"e148-1 x-section\" >\n      \n<div class=\"e148-2 x-container max width\" >\n    \n<div class=\"e148-3 x-column x-sm x-1-1\" >\n    \n<div class=\"e148-4 x-text\" >\n  <font color=\"#848484\"; size=\"+2;\">The Limited<br><strong>\nVictoria's Secret Pink<\/strong><\/font><\/br>\n<font color=\"#848484\" size =\"+2\"> Case Study | Application Performance Engineering<\/font><\/div>\n<\/div>\n<\/div>\n\n<div class=\"e148-10 x-container max width\" >\n    \n<div class=\"e148-11 x-column x-sm x-1-1\" >\n    \n<div class=\"e148-12 x-text\" >\n  <p><p><strong><font color=\"black\" size =\"+1\">About the Customer<\/font><\/strong>\n<p>\nVictoria\u2019s Secret Pink is a wildly successful website, currently with over eleven million members. The creative company behind this viral digital marketing campaign was Resource\/Ammirati. Resource is a brilliantly talented digital advertising agency, an exemplary corporate citizen, and our long term local partner.\n<p> <\/div>\n<\/div>\n<\/div>\n\n<div class=\"e148-18 x-container max width\" >\n    \n<div class=\"e148-19 x-column x-sm x-1-1\" >\n    \n<div class=\"e148-20 x-text\" >\n  <p><p><strong><font color=\"black\" size =\"+1\">The Challenge<\/font><\/strong>\n<p>\nThe pink applications\u2019 initial production performance baseline exhibited response time degradation at only seven concurrent users. Resource enlisted our team to provide 24\u00d77 service desk, operations, technical support, hosting, and performance engineering of the entire Pink technology stack, as a turn-key solution. When we took over hosting the site, usage was growing exponentially, and mass email\/text\/social media advertisements were beginning to cause noticeable slowdowns. <p> \n<\/div>\n<\/div>\n<\/div>\n\n<div class=\"e148-26 x-container max width\" >\n    \n<div class=\"e148-27 x-column x-sm x-1-1\" >\n    \n<div class=\"e148-28 x-text\" >\n  <p><p><strong><font color=\"black\" size =\"+1\">Benefits<\/font><\/strong>\n<p>\nDCI developed a re-engineering plan that included graphical performance data from the grid monitoring system to compare each performance enhancement. DCI provided database and application performance tuning, network design and optimization, and extreme-scale cloud-based global performance testing. The test-analyze-fix cycles took about a month to increase performance from seven concurrent users to our target of forty thousand concurrent users.\n<p> \n\n\n<\/div>\n<\/div>\n<\/div>\n\n<div class=\"e148-34 x-container max width\" >\n    \n<div class=\"e148-35 x-column x-sm x-1-1\" >\n    \n<div class=\"e148-36 x-text\" >\n  <p><p><strong><font color=\"black\" size =\"+1\">Solution<\/font><\/strong>\n<p><strong><font color=\"#848484\" size =\"+1\">\nForensic Data Analysis<\/font><\/strong>\n<p>\nDCI\u2019s data scientists processed all existing log data to analyze historic performance characteristics. The forensic data revealed that poor performance was more frequent and severe than qualitative observations suggested. The log data analysis also provided real-world usage patterns necessary to develop a test suite that accurately modeled common user workflow volume and relative frequency.\n<\/p>\n<p><strong><font color=\"#848484\" size =\"+1\">DevOps Automation<\/font><\/strong>\n<p>\nWhile our performance team established the initial performance baseline, our DevOps team completely automated the web application\u2019s build, deployment, and testing processes. Automating the build improved the efficiency and reliability of releases, but more importantly, it gave us the opportunity to inject custom instrumentation code into the codebase. \nThe instrumentation provided detailed metrics for all of the application\u2019s external dependencies, providing new insight into the real-time status of virtual machines, cache providers, resource pools, databases, and external service providers. The metrics were available as a secure web service that only impacted performance when explicitly invoked.\n\n<\/p>\n\n<p><strong><font color=\"#848484\" size =\"+1\">Grid Monitoring<\/font><\/strong>\n<p>\nOnce the performance team had established a repeatable initial performance baseline, our infrastructure team instrumented the operating systems, virtual runtime environments, database servers, application servers, web servers, and network devices. The always-on low overhead monitors provided hundreds of metrics that were aggregated and displayed graphically using an open-source distributed grid monitoring dashboard. An open source alerting tool interrogated the grid monitor to notify stakeholders of any resource constraints and track availability incidents.\n<p>\n\n<\/p><p><strong><font color=\"#848484\" size =\"+1\">Performance Engineering<\/font><\/strong>\n<p>\n<p>\nOur engineers used empirical data gathered from the stack instrumentation during repeated load tests to identify and tune each inefficient configuration item, independently measuring and documenting the relative performance of every change. The instrumentation easily identified a major bottleneck in the database connection pool configuration. Other database optimizations were necessary at over 100 transactions per second, including explain plans that yielded inefficient\/missing indexes, pessimistic concurrency causing unnecessary blocking operations, a hyper-threading incompatibility that caused cache misses, etc.\nWe meticulously documented the relative performance increase of each change that we made to the system. The database tier accounted for the majority of the significant performance opportunities. As database performance improved, the web and application server tiers benefited from minor heap, thread, and directive optimization. Operating system, load-balancer, firewall, and network tuning accounted for negligible performance improvement relative to application data concurrency engineering.\n<\/p>\n\n<\/div>\n<\/div>\n<\/div>\n\n<div class=\"e148-42 x-container max width\" >\n    \n<div class=\"e148-43 x-column x-sm x-1-1\" >\n    \n<div class=\"e148-44 x-text\" >\n  <p><p><strong><font color=\"black\" size =\"+1\">Results<\/font><\/strong>\n<p>Victoria\u2019s Secret Pink is a wildly successful website, currently with over eleven million members. The creative company behind this viral digital marketing campaign was Resource\/Ammirati. Resource is a brilliantly talented digital advertising agency, an exemplary corporate citizen, and our long term local partner.<\/p><p><\/p><\/div>\n<\/div>\n<\/div>\n  <\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"template-blank-1.php","meta":[],"yst_prominent_words":[310,302,311,304,306,301,314,308,309,315,303,317,204,313,318,307,316,184,305,312],"_links":{"self":[{"href":"https:\/\/www.devconinc.com\/dci\/wp-json\/wp\/v2\/pages\/148"}],"collection":[{"href":"https:\/\/www.devconinc.com\/dci\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.devconinc.com\/dci\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.devconinc.com\/dci\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.devconinc.com\/dci\/wp-json\/wp\/v2\/comments?post=148"}],"version-history":[{"count":1,"href":"https:\/\/www.devconinc.com\/dci\/wp-json\/wp\/v2\/pages\/148\/revisions"}],"predecessor-version":[{"id":2535,"href":"https:\/\/www.devconinc.com\/dci\/wp-json\/wp\/v2\/pages\/148\/revisions\/2535"}],"wp:attachment":[{"href":"https:\/\/www.devconinc.com\/dci\/wp-json\/wp\/v2\/media?parent=148"}],"wp:term":[{"taxonomy":"yst_prominent_words","embeddable":true,"href":"https:\/\/www.devconinc.com\/dci\/wp-json\/wp\/v2\/yst_prominent_words?post=148"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}