In this Building the Analytics-Driven Operation | Comprehensive course, participants will build an analytic operation in stages to experience the natural messiness of predictive analytics. No other training in the market provides such an immersive, skill-reinforcing and complete view of the practice – particularly with a real-world focus and vendor-neutral perspective.
If you are a business or public sector leader or practitioner looking to propel your organization’s analytic maturity and put predictive analytics to work for measurable gain, then this course is designed for you. You do not need to know how code or have stats experience to participate.
Who Should Attend The Building the Analytics-Driven Operation | Comprehensive Seminar?
- IT Executives and Big Data Directors
- Line-of-Business Executives and Functional Managers
- Data Scientists
- Technology Planners
- Consultants
Upon successful completion, students will earn 45 INFORMS Professional Development Units.
Prerequisites
Registrants will be required to view a three-hour online video Core Concepts orientation prior to attending this event. Access details to the Core Concepts video modules will be shared with participants prior to the start of the course. Prior education or experience in data analytics or statistics is helpful, but not required.
Participants need only supply a laptop computer with Microsoft Excel. Instructions on how to download exercise data and any analytic tools will be provided in the preparatory email. The instructor can assist participants with any preparation during breaks, and before or after class.
What Makes This Seminar Unique
This course provides a methodical, holistic and strategic approach to predictive analytics. Most organizations jump directly into data and tools that tend to produce good models… and their projects fail. They fail because they have not anticipated how to integrate the project in the organization. Those who make the investment to fully assess their environment, situation, resources and objectives across all team members will produce project results that are measurable, accountable, actionable and impactful.
Unlike any other course on the market, the Comprehensive Experience course steps through the full build of an analytic operation within the realistic environment of a large organization. Leaders who take this course will interact more effectively with their teams at the tactical level, while analytic practitioners will complement their existing algorithmic background with a more strategic goal-driven focus.
In the end, the organization will be greatly strengthened with team members who operate within a common platform that makes predictive analytics purposeful and impactful. Those who complete this course will be capable of guiding their organization to build a thriving internal analytic practice with measurable and residual gains.
In the end, the organization will be greatly strengthened with team members who run from a common platform that insists on making predictive analytics purposeful and impactful. This course is intended for those willing to invest in developing skills for superior project design and incremental development to overcome chronic analytic failings. Those who complete this course will be capable of guiding their organization to stand up a thriving internal analytic practice with measurable and residual gains.
Syllabus
Core Concepts
- Prerequisite Three-Hour Preparatory Orientation
- View the full Core Concepts Prerequisite Description
Assess Phase
- Assemble Team
- Leadership, Analysts, Subject Experts, Data Support, Stakeholders, etc
- Determine Whether External Talent is Needed
- Examine Culture & Mindset
- List Candidate Projects
- Place Projects on a Benefits / Challenges Quadrant Plot
- Guided Discussion Breakout Session
- Define Performance Benchmarks
- Identify Data Sources
- Itemize Existing Analytic Resources
- Describe Operational Environments
- Initial Report of Overall Practice Readiness
- What Should an Assess Phase Report Contain?
- Exercise Breakout Session
Plan Phase
- Pull & Recon Data
- Explore Data & Verify Quality
- Do We Have Enough Data?
- Which Data are Relevant?
- Make a First Look at Data Quality
- Exercise Breakout Session
- Design Analytic Sandbox
- Qualify Team
- Qualify Tools
- Define Operational Environment(s)
- Establish Performance Benchmarks & Targets
- What are the current metrics (KPIs)?
- What is the Role of Technical Metrics vs. KPIs?
- Benchmark Demonstration
- Consider Deployment Options
- Prioritize Viable Projects
Prepare Phase
- Initiate Analytic Culture & Mindset Shift
- Refine Team Roles & Responsibilities
- Build Analytic Sandbox
- The Importance of the “Data Recon”
- Effective Collaboration Between Analysts and IT
- Exercise Breakout Session
- Define Performance Benchmarks
- Explore Final Data
- Comparing Data Requirements to Actual Data
- Looking for Potential Problems
- Data Exploration Demonstration
- Data Integration
- Data Cleaning
- Data Construction
- Exercise Breakout Session
- Select Candidate Modeling Techniques
- Develop Roll-out Plan for Go-Live
Model Phase
- Current Trends in Analytic Modeling, Data Mining and Machine Learning
- Algorithms in the News: Deep Learning
- The Modeling Software Landscape
- The Rise of R and Python: The Impact on Modeling and Deployment
- Do I Need to Know About Statistics to Build Predictive Models?
- Strategic and Tactical Considerations in Choosing a Modeling Algorithm
- What is an Algorithm?
- Is a “Black Box” Algorithm an Option for Me?
- The Tasks of the Model Phase
- Generate Test Design
- Train-Test Validation
- Accept or Reject Modeling Parameters
- Test / Test / Validate
- Optimizing Data for Different Algorithms
- Build Models
- Classification
- Issues Unique to Classification Problems
- Why Classification Projects are So Common
- An Overview of Classification Algorithms
- Logistic Regression
- Neural Networks
- Naïve Bayes Classification
- Support Vector Machines
- Decision Trees
- Ensemble Methods
- Value Estimation and Regression
- Clustering
- Association Rules
- Other Modeling Techniques
- Times Series
- Text Mining
- Factor Analysis
- Model Assessment
- Evaluate Model Results
- Check Plausibility
- Check Reliability
- Model Accuracy and Stability
- Lift and Gains Charts
- Modeling Demonstration
- Assess Model Viability
- Select Final Models
- Why Accuracy and Stability are Not Enough
- What to Look for in Model Performance
- Exercise Breakout Session
- Create & Document Modeling Plan
- Determine Readiness for Deployment
- What are Potential Deployment Challenges for Each Candidate Model?
- Exercise Breakout Session and Guided Project Discussion
Validate Phase
- Select the Most Strategic Model Option(s)
- Validate Finalist Models
- Prepare Data for Test Deployment
- Data Preparation Steps for Production
- Data Preparation Demonstration
- Measure Lift / ROI / Impact
- The Potential Challenges of Estimating ROI
- Designing an Effective “Dress Rehearsal”
- The Basics of A/B testing
- Exercise Breakout Session
- Test Deployment
- Document Validation Process
Deploy Phase
- Change Management for New Decision Process
- Streamline Data Preparation for Deployment
- Revisiting Data Prep with an Eye toward Deployment
- Considering Deployment Options
- Data Preparation Demonstration
- Review All Project Functions
- Go Live
- Prepare Final Report
- Conduct Knowledge Transfer
Monitor Phase
- Create Maintenance Schedule
- Assign Monitoring Responsibilities
- Build Performance Dashboard
- Who Will be in Charge of Monitoring?
- How with the Monitoring Information be Updated?
- Exercise Breakout Session
- Define Criteria for Model Refresh or Replace
- Develop Monitoring & Maintenance Plan
- Putting a Proper Plan and Schedule into Place
- Monitoring Demonstration
- Identify New Data Sources
- Record Changes to Environment and Organization
Wrap-up and Next Steps
- Supplementary Materials and Resources
- Conferences and Communities
- Get Started on a Project!
- Options for Strategic Oversight and Collaborative Implementation
Request a quote for Building the Analytics-Driven Operation - Comprehensive at your office!