Posts

Hook - Book Notes

Hook - Notes
Trigger - Internal - Emotional External  - Social Action - Behaviour Driven Motivation - Energy for Action Ability - Easier action Reward - Variable Kicks Tribe - Social Gratification Hunt - Game Playing Self - Ramification Investment - For next Cycle Next Trigger - Urge to get excitement Store Value - Reputation, Followers

Digital Architecture

Business Centric Principals: 
Driven by Strategy
Digital Fitness Assessment Digital Generation Design Digital Strategy and Planning Using Technology
Digital Asset Management Digitized Enterprise Operations Internet of things Digital Architecture  Experiencing through Designing (redesign) Service Design Interaction Design User Centered Design Thinking  Customer Centric Principals
Interaction Intelligence Integration IT Centric Principals
Flexible System and Services   Reactive - Asynchronous Systems Modularization - API and Micro Services Architecture Cloud Elasticity Velocity and Insightful Data  Event Driven - Lambda Arch (Ngnix, Spark, Kafka, NoSQL) Predictive Modelling - Machine Learning and Deep Learning Systems Agile Engineering Process  Platform Automation - DevOps Agile Team

ML Algirithms - Cheat Sheets

Image
Mind-map of Algorithm: 1. Regression Algorithms Ordinary Least Squares Regression (OLSR) Linear Regression Logistic Regression Stepwise Regression Multivariate Adaptive Regression Splines (MARS) Locally Estimated Scatterplot Smoothing (LOESS) 2. Instance-based Algorithms k-Nearest Neighbour (kNN) Learning Vector Quantization (LVQ) Self-Organizing Map (SOM) Locally Weighted Learning (LWL) 3. Regularization Algorithms Ridge Regression Least Absolute Shrinkage and Selection Operator (LASSO) Elastic Net Least-Angle Regression (LARS) 4. Decision Tree Algorithms Classification and Regression Tree (CART) Iterative Dichotomiser 3 (ID3) C4.5 and C5.0 (different versions of a powerful approach) C…

ML - Course Notes

2 - Linear Regression:
Problem Given a data set plotted on graph (x,y). Find out hypothesis which represent the data behavior Hypothesis f(x) : Represent its behavior f(x) = a + b Xi a and b controls the prediction Slop of line which fits the data Cost Function Minimize the Cost Function J(T) = 1/2m * { Sum (Yi - f(Xi)) ^2 } : m is total nu of data set J(T) = 1/2m * { Sum (Yi - (a + b Xi)) ^2 } Gradient Descent Mechanism to find value of a and b where Cost function value is lowest Incrementally minimize the multivariate cost function Leads to Global and Local Minimum  Repeat until convergence Pj := Pj - Alpha * d/dPj (J(T0,T1)) P0 := P0 - Alpha * d/dP0 (J(P0)) Pj := Pj - Alpha * d/dPj (J(Pj) Pj := Pj - Alpha * J(Pj) * Pj Pj : Values of a, b   Alpha : size of step ; Size of Prediction ; Automatically reduces alpha value Update both T0 and T1 Formula Hypothesis f(x) = T1 X1 + T2 X2 Cost Function J(T) = 1/2m * {Sum (1-m) (f(x) - Y) ^2}Minimize the Cost Function Gradient Descend: T1 := T1…

Data Pipeline Processing

Big Data - Tech Stack:
Analytical Tool R Tool  Machine Learning Apache Mahout  Query System Hive Pig Cache System  Memcache Redis  Data Serialize Apache Avro  Processing System (Batch) Apache HadoopMap Reduce / HDFS Processing (RT) Apache Spark Apache Storm Message System Apache Kafka NOSQL Apache CassandraApache HBase Storm:
Nugget - Distributed Reliable Real Time Data Processing System Meant for Real time Steaming data vs Batch processing of Hadoop Diff with hadoop - Task are continuous vs task with completion Reads the data from Messaging queues Fail over - On failed execution, it restart the task on another node Reliability - Based on Spout - Ability to repeat tuple to bolt  Tuple - Boundless data with Schema Spout - Consumer of data stream from external Source Bolt - Description of topology Spout > Topology - Bolt > Worker > Executor > TaskWorker can execute tasks of Bolt and Spout. Parallelism is defined no of executor running for each Bolt and spout.  Kafka:
Nugget -…

Solution Architecture - Framework & Structure

Solution Architecture : Framework Business:
Inputs Requirements  - Problem (VOC) / Future Vision  Structure Business Opportunity - Profit, Market share, Position  Pain Point -  KPI Marketing - Customer Financial - Bottom line / Top Line Operations - Engineering / Operations  Approach Articulation - Current System, Pain Point, Vision, Solution, Benefits (Value Prop )  Approach - What is; What If, What Wow, What Works (Design thinking)   Output Business Architecture Domain:
Input Requirement - Business  Structure Processes and Sub Process System and Sub Systems Business Use Case  Approach Articulation - Use Case Scenarios / Example Output Domain Architecture (Functional) Architecture:
Inputs Business and Domain Architecture  Structure Architecture Diagram - Logical, Application and Data Principals & Consideration - NFR,  Process & System Approach Articulation - Top Down  Approach - Methodology (Layered; Component)  Output System Architecture (Logical/Application)  Information Arc…