Jon Cohn Exton PA - Corporate Data Architecture

A complete revisiting of the corporate data architecture and its respective best
practices is in order because of cloud computing and big changes in computing
technology and software development. In some cases, a complete inversion has
occurred (in the best way) to solve a particular problem. To be competitive,
organizations need to take advantage of these new ways of doing things.
Massive data and information is out there if we can just grasp it. Below are some
principles and practices on how we can better deal with data going forward.
Store First, Analyze Later: Disk is cheap. We cant always predict what data will
be important later. Store first and ask questions later. With scalable
infrastructure and todays hardware economics, its okay if a piece of data turns
out to never be used. The schema flexibility of NoSQL technology facilitates this.
For example, with a customer document, adding additional fields of information
at a later date is easy even if they were not envisioned initially.
Default to Real-time: Historically, data processing and analysis has been done via
batch processing. We defaulted to batch processing because its computationally
efficient however, given Moores law and the passage of time we now have much
more power at our disposal. We can afford to do more work to get real-time
answers instead of answers tomorrow. NoSQL and fast storage technologies
(such as solid state disk) make real-time possible. Your organization should
deliver recommendations, personalization and business metrics immediately.
Default to real-time and go to batch only when necessary.
Structure Shouldnt Hold You Back: Its easy to store basic stock information for
example (ticker, high, low, close) in any database. What about a complete
derivative security? How do we store that in the database, especially given that
new securities are invented all the time? A legal contracts terms? How do we
store polymorphic information or data we werent aware of a priori?
Historically a few methods have been most common: the relational database for
data with very precise structuring; completely unstructured data (BLOBs); and
things in the middle, such as spreadsheets. The latter two formats are mostly
useless for integration into your applications, yet the volume of such data is
massive. With the rise of dynamic document-oriented data models (using JSON),
semi-structured, complex structured, and polymorphic data can be stored,
accessed and organized just as efficiently as the more rigidly structured data
that has been in databases traditionally.
Agility Is Key: The software development world has moved from classic
waterfall software development lifecycles to more agile, or iterative,
methodologies (for example, Scrum). These methods rapid iteration allows
organizations to deliver features and enhancements to end users quickly and
effectively. To work this way, we need new tools that are agile-compatible
version control, continuous integration, programming languages have adapted
already. We need similar adaption by the database if we want to make software

development nimble and productive. NoSQL technologies facilitate iteration in

the data model much the same way as you iterate with your code.
One Size Doesnt Fit All: One-size-fits-all is over. Use multiple database
technologies as part of your standard enterprise technology platform. You wont
want dozens that would be far too complex but more than one is optimal. A
good model for the future is to have three primary tools: an DBMS, a relational
data warehouse and a NoSQL database. For each project or sub-problem, use
whichever tool is best. Augment with niche tools (e.g., a time series database)
for special cases. The above approach is highly compatible with service-oriented
architectures, which you should be using. Monolithic hub-and-spoke architectures
lead to late projects and unchangeable systems. Instead, build web services
with each one potentially having its own database or datamart behind it.
Go Commodity: The rise of commodity hardware as a viable production platform
has made it possible to deploy multi-node systems quickly. Newer database
technologies are designed with commodity servers in mind. Companies are
moving away from big iron servers and embrace this approach. By adopting a
commodity server deployment model, there is less of a dependency on
proprietary mechanisms and vendor lock-in is often avoided. Find the sweet spot
on the price-performance curve and buy servers of that size. Dont buy $1k
servers, youll have too many to manage (or even plug in!) But dont go too big
either. Many organizations are standardizing on $10k commodity Xeon (or AMD)
based servers with gigabit Ethernet.
Use Solid State Drives a Lot: Traditional spinning disks have increased in
capacity and data transfer rates by a factor of one thousand, yet the random i/o
times have barely budged over a decade. If you are doing any random I/O at all,
you should use SSDs instead. Commodity SATA-style SSDs can work surprisingly
well. Be sure to mirror them they still fail even though there are no moving
parts (except electrons!) Reserve 20%+ of the disks space as un-partitioned to
give the drive room to optimize random writes and avoid excess write
amplification.
For sequential I/O, stick to spinning disks. Thus, use spinning disks for Hadoop
batch processing and for backups. Some have predicted eventually 99% of data
may be stored on spinning disks yet 99% of accesses will be happening on SSDs.
With spinning disks being the main place for backups, that is conceivable.
Source : forbes.com
Recommended by :
Jon Cohn ,CTO , VP IT Architecture
https://www.linkedin.com/in/jonacohn
joncohn@comcast.net

"Jon Cohn Exton PA" "Jon Cohn Exton" "Jon Cohn Evolution"

https://docs.google.com/document/d/1jhU5Mis7YoGzJvK85coGd8yZIHs-JnCG_cyzp_y9Jk/edit?usp=sharing
http://issuu.com/jonacohn/docs/jon.cohn.resume.docx
https://www.scribd.com/doc/294344968/Jon-cohn-Resume
http://www.slideshare.net/jonacohn/joncohnresume
https://penzu.com/p/e1f1fb23
http://jonacohn.tumblr.com/post/136671484928/jon-a-cohn
https://jonacohn.wordpress.com/2016/01/06/jon-a-cohn/
http://jonacohn.blogspot.com/2016/01/jon-cohn-resume.html
www.slideserve.com/jonacohn/jon-a-cohn-exton-pa
http://www.authorstream.com/Presentation/jonacohn-2711402-jon-cohn-extonpa-19341/
www.slideserve.com/jonacohn/jon-a-cohn-exton-pa
http://slideonline.com/presentation/99077-jon-a-cohn-exton-pa
https://docs.google.com/document/d/1NJujdCMyQTF9qReGp6oMbmvWBXWEqPu1avWwEMAgmo/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/1j3SQfwm6QW
http://jonacohn.blogspot.com/2016/01/knowledge-management-in-software.html
http://docslide.net/technology/knowledge-management-in-softwarearchitecture-.html
http://issuu.com/jonacohn/docs/knowledge_management_in_software_ar
https://www.scribd.com/doc/294345138/Knowledge-Management-in-SoftwareArchitecture
http://www.slideshare.net/jonacohn/knowledge-management-in-softwarearchitecture
https://penzu.com/p/20142217
http://jonacohn.tumblr.com/post/136671606138/knowledge-management-insoftware-architecture

https://jonacohn.wordpress.com/2016/01/06/knowledge-management-insoftware-architecture-state-of-the-art/
https://docs.google.com/document/d/1CfsHdjb2TmLzBqgUu5bqTolxNJIJdYyj4WKvY
s9Isqc/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/RQtZGoR4qEd
http://jonacohn.blogspot.com/2016/01/microservice-architecture-patternsand.html
http://docslide.net/technology/microservice-architecture-patterns-and-bestpractices-.html
http://issuu.com/jonacohn/docs/microservice_architecture_patterns_
https://www.scribd.com/doc/294345139/Microservice-Architecture-Patterns-andBest-Practices
http://www.slideshare.net/jonacohn/microservice-architecture-patterns-and-bestpractices
https://penzu.com/p/4a54eb47
http://jonacohn.tumblr.com/post/136671688403/microservice-architecturepatterns-and-best
https://jonacohn.wordpress.com/2016/01/06/microservice-architecture-patternsand-best-practices/
https://docs.google.com/document/d/16a4js8-8AungetG1O1J5G2LfCOsiv6nvWfAJDL0itI/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/AR8bEGBYukJ
http://jonacohn.blogspot.com/2016/01/microservices-anti-patterns.html
http://docslide.net/technology/microservices-anti-.html
http://issuu.com/jonacohn/docs/microservices_anti.docx
https://www.scribd.com/doc/294345141/Microservices-Anti
http://www.slideshare.net/jonacohn/microservices-anti
https://penzu.com/p/fb7180ed
http://jonacohn.tumblr.com/post/136671725568/microservices-anti-patterns
https://jonacohn.wordpress.com/2016/01/06/microservices-anti-patterns/
https://docs.google.com/document/d/1yW3qK63RbReFDM0u7QaFaN6GQ7aztbova
v7eKbKaUyg/edit?usp=sharing

https://plus.google.com/105089455909133040148/posts/JoonTaUmWJN
http://jonacohn.blogspot.com/2016/01/software-architecture-antipatterns.html
http://docslide.net/technology/software-architecture-antipatterns-.html
http://issuu.com/jonacohn/docs/software_architecture_antipatterns.
https://www.scribd.com/doc/294345142/Software-Architecture-AntiPatterns
http://www.slideshare.net/jonacohn/software-architecture-anti-patterns
https://penzu.com/p/623a155f
http://jonacohn.tumblr.com/post/136671788668/software-architectureantipatterns
https://jonacohn.wordpress.com/2016/01/06/software-architecture-antipatterns/
https://docs.google.com/document/d/1amUg47H3WiWfjFyCEXuE2IW0BjsRpy5FcS
21ocskPfo/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/3wnZwvKRJVw
http://jonacohn.blogspot.com/2016/01/5-ways-cios-can-rationalizeapplication.html
http://docslide.net/technology/5-ways-cios-can-rationalize-applicationportfolios-.html
http://issuu.com/jonacohn/docs/5_ways_cios_can_rationalize_applica
https://www.scribd.com/doc/294345398/5-Ways-CIOs-Can-Rationalize-ApplicationPortfolios
http://www.slideshare.net/jonacohn/5-ways-ci-os-can-rationalize-applicationportfolios
https://penzu.com/p/59d0714d
http://jonacohn.tumblr.com/post/136671848208/5-ways-cios-can-rationalizeapplication-portfolios
https://jonacohn.wordpress.com/2016/01/06/5-ways-cios-can-rationalizeapplication-portfolios/
https://docs.google.com/document/d/1mxok-5UOtBtOrf_DnXYuJuqWjXz_5dmM6dIWIz42Qo/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/8zoDBqkuVUY
http://jonacohn.blogspot.com/2016/01/8-enterprise-software-predictions.html
http://docslide.net/technology/8-enterprise-software-predictions-.html

http://issuu.com/jonacohn/docs/8_enterprise_software_predictions.d
https://www.scribd.com/doc/294345403/8-Enterprise-Software-Predictions
http://www.slideshare.net/jonacohn/8-enterprise-software-predictions-56574229
https://penzu.com/p/bb8da598
http://jonacohn.tumblr.com/post/136671903488/8-enterprise-softwarepredictions
https://jonacohn.wordpress.com/2016/01/06/8-enterprise-software-predictions/
https://docs.google.com/document/d/1j6vNIc8UPFBBDwY9Pf3JotXOz2rFFED1_RUi
v3uAITA/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/1KzDqVAbsPe
http://jonacohn.blogspot.com/2016/01/9-enterprise-tech-trends-for-2016and.html
http://docslide.net/technology/9-enterprise-tech-trends-for-2016-andbeyond-.html
http://issuu.com/jonacohn/docs/9_enterprise_tech_trends_for_2016_a
https://www.scribd.com/doc/294345405/9-Enterprise-Tech-Trends-for-2016-andBeyond
http://www.slideshare.net/jonacohn/9-enterprise-tech-trends-for-2016-andbeyond
https://penzu.com/p/1d693de8
http://jonacohn.tumblr.com/post/136671931568/9-enterprise-tech-trends-for2016-and-beyond
https://jonacohn.wordpress.com/2016/01/06/9-enterprise-tech-trends-for-2016and-beyond/
https://docs.google.com/document/d/1MYjcjtP9GbvwW9jCjCHWq6giriccM1DspbFb
wX4qyCk/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/iZWpb25woCS
http://jonacohn.blogspot.com/2016/01/best-practices-enterprisearchitecture.html
http://docslide.net/technology/best-practices-joncohn202.html
http://issuu.com/jonacohn/docs/best_practices.docx
https://www.scribd.com/doc/294345407/Best-Practices

http://www.slideshare.net/jonacohn/best-practices-56574259
https://penzu.com/p/63e3b811
http://jonacohn.tumblr.com/post/136672044823/best-practices-enterprisearchitecture
https://jonacohn.wordpress.com/2016/01/06/best-practices-enterprisearchitecture/
https://docs.google.com/document/d/1Wb04CK1FHTJUxRibL74u_YwYf5dxyEqOK5
wUgNpcU2g/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/DyvwQzQUnsS
http://jonacohn.blogspot.com/2016/01/enterprise-architecture-innovation.html
http://docslide.net/technology/enterprise-architecture-.html
http://issuu.com/jonacohn/docs/enterprise_architecture.docx
https://www.scribd.com/doc/294345410/Enterprise-Architecture
http://www.slideshare.net/jonacohn/enterprise-architecture-56574277
https://penzu.com/public/c15a5fd5
http://jonacohn.tumblr.com/post/136672100058/enterprise-architectureinnovation-management
https://jonacohn.wordpress.com/2016/01/06/enterprise-architecture-innovationmanagement-exploring-the-links/
https://docs.google.com/document/d/11ufZjAbBpLn_fnG3q3b1JqVhCRSK0YxnJAmql1H4W0/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/GgDtXx7nMRs
http://jonacohn.blogspot.com/2016/01/seven-best-practices-for.html
http://docslide.net/technology/seven-best-practices-for-revolutionizing-yourdata-.html
http://issuu.com/jonacohn/docs/seven_best_practices_for_revolution
https://www.scribd.com/doc/294345412/Seven-Best-Practices-for-RevolutionizingYour-Data
http://www.slideshare.net/jonacohn/seven-best-practices-for-revolutionizing-yourdata
https://penzu.com/p/ba199cb7

http://jonacohn.tumblr.com/post/136672128658/seven-best-practices-forrevolutionizing-your-data
https://jonacohn.wordpress.com/2016/01/06/seven-best-practices-forrevolutionizing-your-data/
https://docs.google.com/document/d/1t8Q6bRX8mX3mrVczTxlk4rzRJalcYNvNC7d
1M-XF3Ao/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/Ku4Fj2SC15z
http://jonacohn.blogspot.com/2016/01/six-steps-to-data-governancesuccess.html
http://docslide.net/technology/six-steps-to-data-governance-success-.html
http://issuu.com/jonacohn/docs/six_steps_to_data_governance_succes
https://www.scribd.com/doc/294345415/Six-Steps-to-Data-Governance-Success
http://www.slideshare.net/jonacohn/six-steps-to-data-governance-success
https://penzu.com/p/f152cfd5
http://jonacohn.tumblr.com/post/136672450458/six-steps-to-data-governancesuccess
https://jonacohn.wordpress.com/2016/01/06/six-steps-to-data-governancesuccess/
https://docs.google.com/document/d/16lyD986BUJSQNRGZ5L_EGaVoj03XP4qCuMYi6lpb1A/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/h54EfyrsDLh
http://jonacohn.blogspot.com/2016/01/the-big-data-architecture-dilemmafor.html
http://docslide.net/technology/the-big-data-architecture-dilemma-for-cios-.html
http://issuu.com/jonacohn/docs/the_big_data_architecture_dilemma_f
https://www.scribd.com/doc/294345419/The-Big-Data-Architecture-Dilemma-forCIOs
http://www.slideshare.net/jonacohn/the-big-data-architecture-dilemma-for-ci-os
https://penzu.com/p/427555f6
http://jonacohn.tumblr.com/post/136672497063/the-big-data-architecturedilemma-for-cios
https://jonacohn.wordpress.com/2016/01/06/the-big-data-architecture-dilemmafor-cios/

https://docs.google.com/document/d/1Dn-1qgitLF-abiZwWE5WAAvaiO7vBgXWGVIYh8v6ao/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/gxMGKV2uiDn
http://jonacohn.blogspot.com/2016/01/the-next-generation-of-enterprise-it.html
http://docslide.net/technology/the-next-generation-of-enterprise-it-.html
http://issuu.com/jonacohn/docs/the_next_generation_of_enterprise_i
https://www.scribd.com/doc/294345420/The-Next-Generation-of-Enterprise-IT
http://www.slideshare.net/jonacohn/the-next-generation-of-enterprise-it
https://penzu.com/public/c3a53beb
http://jonacohn.tumblr.com/post/136672518848/the-next-generation-ofenterprise-it
https://jonacohn.wordpress.com/2016/01/06/the-next-generation-of-enterprise-it/
https://docs.google.com/document/d/1tXutYHc6npuklzT79T7ZN4Ck6OFgS2zv5gC
c5KLW0kI/edit?usp=sharing
https://plus.google.com/105089455909133040148/posts/XFQccKewNBv
http://jonacohn.blogspot.com/2016/01/where-is-enterprise-architecture-in.html
http://docslide.net/technology/where-is-enterprise-architecture-inhealthcare-.html
http://issuu.com/jonacohn/docs/where_is_enterprise_architecture_in
https://www.scribd.com/doc/294345421/Where-is-Enterprise-Architecture-inHealthcare
http://www.slideshare.net/jonacohn/where-is-enterprise-architecture-inhealthcare-56574321
https://penzu.com/public/f3710120
http://jonacohn.tumblr.com/post/136672547973/where-is-enterprise-architecturein-healthcare
https://jonacohn.wordpress.com/2016/01/06/where-is-enterprise-architecture-inhealthcare/
https://docs.google.com/document/d/1UCdQJ4UPr0sqKYVS0nSUcXDZGGsm6Td9q
xZXdSeII38/pub
https://plus.google.com/105089455909133040148/posts/J8z1N41J9GB
http://jonacohn.blogspot.com/2016/01/jon-cohn-exton-pa-architectural.html

http://docslide.net/technology/jon-cohn-exton-pa-architectural-knowledge-.html
http://issuu.com/jonacohn/docs/jon_cohn_exton_pa_-_knowledge_manag
https://www.scribd.com/doc/296953303/Jon-Cohn-Exton-PA-KnowledgeManagement-in-Software-Architecture
http://www.slideshare.net/jonacohn/jon-cohn-exton-pa-knowledge-managementin-software-architecture
http://jonacohn.tumblr.com/post/138274190333/jon-cohn-exton-pa-architecturalknowledge
https://jonacohn.wordpress.com/2016/01/29/jon-cohn-exton-pa-architecturalknowledge/
https://docs.google.com/document/d/1Uc0C0-6rDH26SNMBUpzFpCBJb8rux48sorLtEe4IdU/pub
https://plus.google.com/105089455909133040148/posts/crcvFw8XqRt
http://jonacohn.blogspot.com/2016/01/jon-cohn-exton-pa-evolution-of.html
http://docslide.net/technology/jon-cohn-exton-pa-evolution-of-applicationarchitectures-.html
http://issuu.com/jonacohn/docs/jon_cohn_exton_pa_-_microservice_ar
https://www.scribd.com/doc/296953384/Jon-Cohn-Exton-PA-MicroserviceArchitecture-Patterns-and-Best-Practices
http://www.slideshare.net/jonacohn/jon-cohn-exton-pa-microservice-architecturepatterns-and-best-practices
http://jonacohn.tumblr.com/post/138274220218/jon-cohn-exton-pa-evolution-ofapplication
https://jonacohn.wordpress.com/2016/01/29/jon-cohn-exton-pa-evolution-ofapplication-architectures/
https://docs.google.com/document/d/13m3rjLzR23a0QaXqBV823IsTnIz7WUYGOpPubuO0Iw/pub
https://plus.google.com/105089455909133040148/posts/iUCqzFRfkvX
http://jonacohn.blogspot.com/2016/01/jon-cohn-exton-pa-good-architecture.html
http://docslide.net/technology/jon-cohn-exton-pa-good-architecture-criticalfactor-.html
http://issuu.com/jonacohn/docs/jon_cohn_exton_pa_-_microservices_a
https://www.scribd.com/doc/296953475/Jon-Cohn-Exton-PA-Microservices-Anti

http://www.slideshare.net/jonacohn/jon-cohn-exton-pa-microservices-anti
http://jonacohn.tumblr.com/post/138274242328/jon-cohn-exton-pa-goodarchitecture-critical
https://jonacohn.wordpress.com/2016/01/29/jon-cohn-exton-pa-goodarchitecture-critical-factor/
https://docs.google.com/document/d/1Jky1RZoDZ0K3WyaC4Z6-Sx_tfi_xDogcP1_PMm7k2M/pub
https://plus.google.com/105089455909133040148/posts/jYnfohSbr8G
http://jonacohn.blogspot.com/2016/01/jon-cohn-exton-pa-microservices.html
http://docslide.net/technology/jon-cohn-exton-pa-microservicesarchitecture-.html
http://issuu.com/jonacohn/docs/jon_cohn_exton_pa_-_software_archit
https://www.scribd.com/doc/296953580/Jon-Cohn-Exton-PA-SoftwareArchitecture-AntiPatterns
http://www.slideshare.net/jonacohn/jon-cohn-exton-pa-software-architecture-antipatterns
http://jonacohn.tumblr.com/post/138274281533/jon-cohn-exton-pamicroservices-architecture
https://jonacohn.wordpress.com/2016/01/29/jon-cohn-exton-pa-microservicesarchitecture/