🤖 Implementing AI and ML 🧬

AI and Machine Learning aren’t just the latest IT buzzwords—they’re a full-blown step-change in how we think, operate, and occasionally panic about the future. For techies, it’s a thrilling leap into smarter systems, automation, and models that occasionally behave themselves. For CxOs, it’s the promise of efficiency, market edge, and a compelling reason to add “AI-powered” to the next investor slide deck.
Naturally, this means we need two definitions: one that satisfies the engineers’ need for precision and another that reassures the budget holders that this isn’t just an expensive science experiment wearing a hoodie.
🎯 Exec Introduction:Types of AI/ML
For executives, the value lies not in understanding every algorithm, but in knowing which type of AI or ML is best suited to which kind of business problem, and how to scale its use safely and effectively.
Artificial Intelligence (AI) is not one single technology, but rather a family of capabilities that enable machines to simulate human intelligence. Whether it's automating customer service, detecting financial anomalies, or assisting with medical diagnoses, AI is rapidly becoming a cornerstone of modern business strategy.
At the heart of most AI applications is Machine Learning (ML) — the ability of systems to learn from data and improve over time without being explicitly programmed. ML allows organizations to move beyond rule-based automation and tap into predictive and adaptive intelligence.
Understanding the types of AI helps leaders distinguish between short-term opportunities and longer-term aspirations:
- Narrow AI powers today’s practical tools — focused, efficient, and task-specific.
- General AI and Super AI remain future-facing, but they shape our thinking around risk, governance, and innovation.
Similarly, types of Machine Learning define how systems learn:
- Supervised learning is ideal for structured prediction tasks like fraud detection.
- Unsupervised and reinforcement learning uncover insights and drive dynamic optimization.
- Self-supervised learning powers foundation models such as GPT.
🧠 Tech Introduction: Types of AI/ML
Understanding these categories is essential for designing appropriate architectures, selecting suitable training strategies, and deploying scalable AI systems across domains like healthcare, finance, and operations.
Artificial Intelligence (AI) is a broad domain concerned with enabling machines to perform tasks that typically require human cognition — such as perception, reasoning, learning, and decision-making. Within AI, Machine Learning (ML) is the most practical and widely implemented subset, focusing on developing algorithms that can learn from and make predictions or decisions based on data.
🔷 Types of AI (By Capability)
- Narrow AI: Systems trained for specific tasks (e.g., image classification, language translation). Most production-grade AI today falls into this category.
- General AI: Hypothetical systems with human-equivalent cognitive flexibility across domains.
- Super AI: Theoretical AI that surpasses human intelligence in all aspects. Still a research frontier.
🔶 Types of Machine Learning (By Learning Method)
- Supervised Learning: Learns from labeled datasets to map inputs to outputs. Used in classification and regression tasks.
- Unsupervised Learning: Discovers hidden patterns or structures in unlabeled data (e.g., clustering, dimensionality reduction).
- Semi-Supervised Learning: Combines a small labeled dataset with a large amount of unlabeled data. Useful when labeling is costly.
- Reinforcement Learning: An agent learns to make decisions through trial and error by maximizing cumulative rewards in an environment.
- Self-Supervised Learning: A recent paradigm where the system generates its own training labels from the input data. Common in NLP and computer vision (e.g., BERT, GPT).
📊 AI/ML Lifecycle 'n' Stuff
Like most things in IT, there’s a structured framework—because no transformation would be complete without a glossy consultancy playbook, a handful of expert opinions, and a whiteboard session led by someone eager to prove they’re the smartest person in the room.
🧠 Types of Machine Learning (ML)
Type | Description | Common Use Cases |
---|---|---|
Supervised Learning | Learn from labeled data (input → output) | Spam detection, image classification |
Unsupervised Learning | Discover patterns in unlabeled data | Clustering customers, anomaly detection |
Semi-Supervised Learning | Mix of labeled and unlabeled data | Medical imaging, text classification |
Reinforcement Learning | Learn via trial and error from feedback (rewards) | Robotics, game-playing agents (e.g., AlphaGo) |
Self-Supervised Learning | Model generates its own labels from input | Foundation models like GPT, BERT |
🤖 Types of Artificial Intelligence (AI)
🔹 By Capability
Type | Description | Examples |
---|---|---|
Narrow AI | Specialized at one task; most AI today | Siri, ChatGPT, fraud detection |
General AI | Human-level, flexible across domains (theoretical) | Not yet achieved |
Super AI | Surpasses human intelligence (hypothetical) | AI with independent consciousness |
🔸 By Functionality
Type | Description | Examples |
---|---|---|
Reactive Machines | No memory, responds to stimuli | IBM Deep Blue (chess-playing AI) |
Limited Memory | Uses short-term historical data | Self-driving cars, recommender systems |
Theory of Mind | Understands emotions, intent (not yet realized) | Future empathetic assistants |
Self-Aware AI | Sentient, conscious (purely speculative) | Sci-fi concept only |
🧠 Understanding AI/ML Phases, Stages, and Optionality
The AI/ML development lifecycle unfolds in phases that mirror how any strategic capability matures—from idea to impact. Each phase contains discrete stages, which represent the tangible steps taken to move a model from concept to operation. However, not all stages are created equal. Some are foundational, others are optional, and a few may even be bypassed entirely depending on the use case, tools, and project maturity.
🔷 Phase 1: Business Framing
At the outset, the problem definition stage is universally essential. Regardless of technology, every ML initiative starts with understanding the business context, defining the goal, and identifying what a successful model looks like.
This phase is never optional. Example: In MS diagnosis, the goal might be early detection of progression from RRMS to SPMS. In general ledger analytics, it might be reducing false positives in anomaly detection.
🔶 Phase 2: Data Strategy
This phase includes data collection, preparation, and sometimes labeling. While all ML models need data, the depth of effort here varies:
-
Data collection is mandatory—no model without data.
-
Data preparation (cleansing, deduplication, standardization) is almost always required, though some modern tools automate much of this.
-
Data labeling, on the other hand, is only relevant for supervised learning. It's optional (or unnecessary) in unsupervised clustering or when using pre-labeled datasets.
Optionality: A POC anomaly detection model might use historical fraud tags. A live production model may require a custom-labeled dataset by finance auditors or radiologists.
🧩 Phase 3: Feature Strategy
Feature engineering—the art of converting raw data into useful signals—is often essential in traditional ML (e.g., decision trees, logistic regression). However, it's increasingly optional in deep learning or AutoML settings, where raw data (like images or text) can be fed directly into models.
Optionality: GL systems with structured data benefit from engineered features (e.g., day-of-week flags or transaction frequency), while MRI-based models may skip this entirely in favor of CNNs.
🤖 Phase 4: Model Development
This phase covers the technical heart of ML:
-
Model selection
-
Training
-
Evaluation
-
Tuning
All are essential to some degree, though:
-
Tuning (like hyperparameter optimization) may be skipped in a POC or AutoML pipeline.
-
Model evaluation is always required—it's the sanity check before anything goes live.
Optionality: Basic models for exploratory analysis may use defaults, but enterprise-grade solutions must be rigorously trained and validated.
🚀 Phase 5: Operationalization
Here we enter production territory:
-
Model deployment may be optional for ad-hoc or offline scoring use cases.
-
Real-time APIs and CI/CD integrations are necessary only when the model must interact with live systems.
Optionality: A general ledger model might be run monthly during close, while an MS diagnostic model could be embedded into an MRI analysis pipeline and run continuously.
📈 Phase 6: MLOps & Governance
Often neglected in early-stage projects, this phase becomes crucial over time:
-
Monitoring helps detect model drift, performance drops, or bias.
-
Retraining ensures long-term reliability as data evolves.
While optional for a prototype or research project, these stages are non-negotiable in regulated, production-grade systems—especially in healthcare and finance, where accuracy, fairness, and compliance are critical.
Optionality: A model used once in an internal hackathon might not need any monitoring; a clinical ML tool would require full auditability and retraining cycles.
🔁 Final Thought: It's a Dial, Not a Switch
AI/ML is not a one-size-fits-all pipeline. The key is understanding which phases and stages to emphasize based on:
-
Business criticality
-
Data maturity
-
Risk tolerance
-
Deployment intent
Mature teams treat the AI/ML lifecycle not as a checklist, but as a dial that can be tuned—activating or skipping stages depending on the situation.
AI/ML Lifecycle or Machine Learning Development Lifecycle (synonyms)
🔢 Stage | 🏷️ Name | 🔍 Purpose | 🧰 Tools/Notes |
---|---|---|---|
1️⃣ | Problem Definition 🧩 | Understand the business case, define goals, success metrics | Stakeholder input, KPIs, feasibility analysis |
2️⃣ | Data Collection 🧾 | Gather raw data from various sources | Databases, sensors, APIs, ERP, EHR systems |
3️⃣ | Data Preparation 🧱 | Cleanse, standardize, anonymize data | ETL, Azure Data Factory, AWS Glue |
4️⃣ | Data Labeling 🏷️ | Assign ground truth labels for supervised learning | Manual/auto labeling, SageMaker Ground Truth, Azure ML |
5️⃣ | Feature Engineering 🧩 | Derive meaningful input variables from raw data | Statistical transforms, domain logic, ML pipelines |
6️⃣ | Model Selection 🧮 | Choose model types based on task (classification, regression, etc.) | Decision Trees, CNNs, LSTMs, AutoML, etc. |
7️⃣ | Model Training 🧠 | Fit model on training data | SageMaker, Azure ML, Jupyter, GPU clusters |
8️⃣ | Evaluation ⚖️ | Measure accuracy, F1, AUC, precision, recall | Validation datasets, metrics, cross-validation |
9️⃣ | Model Tuning 🎛️ | Optimize performance using hyperparameter tuning | Grid search, Bayesian optimization, AutoML |
🔟 | Model Deployment 🚀 | Make the model accessible via API for real-time or batch inference | SageMaker Endpoints, Azure ML Endpoints, Kubernetes |
1️⃣1️⃣ | Monitoring 📈 | Track model drift, performance, usage | Azure Monitor, CloudWatch, Model Monitor |
1️⃣2️⃣ | Retraining/Feedback 🔄 | Update model with new data to maintain performance | CI/CD pipelines, human-in-the-loop review |
🧠 Scenario Goal: Predict MS Progression from MRI and Patient Data
Business Outcome: Enable early, accurate diagnosis and timely treatment planning by predicting progression from relapsing-remitting MS (RRMS) to secondary progressive MS (SPMS) using MRI and demographic/clinical data.
🏗️ Solution Architecture Overview with Azure and AWS
🔢 Stage | 📌 Purpose | 🔷 Azure Services | 🟧 AWS Services |
---|---|---|---|
🔷 1. Data Ingestion | Collect MRI scans securely | Azure Blob Storage, Azure Data Box, Azure Import/Export | Amazon S3, AWS Snowball, AWS Transfer Family |
⚙️ 2. Data Preprocessing | Clean and anonymize DICOM images | Azure Functions, Azure Batch, Azure Data Factory | AWS Lambda, AWS Glue, Amazon EC2 |
🏷 3. Data Labeling | Label training data for supervised learning | Azure Machine Learning (Data Labeling) | Amazon SageMaker Ground Truth |
🧠 4. Model Training | Train CNN models on MRI datasets | Azure ML Notebooks, Jobs, Experiments | SageMaker Notebooks, Training Jobs, Experiments |
🚀 5. Model Hosting | Serve trained models for inference | Azure Machine Learning Endpoints | SageMaker Endpoints or AWS Lambda |
🔗 6. Prediction & Insights | Run predictions and return results | Azure API Management, Azure Functions, Azure SQL DB / Cosmos DB | API Gateway, Lambda, Amazon RDS / DynamoDB |
📊 7. Visualization Layer | Present predictions to clinicians | Power BI, Azure Static Web Apps, Azure App Service | Amazon QuickSight, AWS Amplify, CloudFront + S3 |
🔐 8. Security & Compliance | Ensure privacy, access control, compliance | Azure Key Vault, Defender for Cloud, Azure Purview, Azure Policy | AWS KMS, IAM, Macie, GuardDuty, AWS HealthLake |
📈 9. Monitoring & Operations | Observe system and model performance | Azure Monitor, App Insights, Log Analytics | CloudWatch, X-Ray, AWS Config |
The crucial insight is that AI and ML are not defined by a single breakthrough but by a growing ecosystem of evolving tools and exponentially increasing data for training. While understanding the underlying mathematics is beneficial, true expertise lies in fluency with these tools and the agility to apply them effectively. This domain is driven by continuous improvement and creative innovation—not by solitary acts of invention.
📘 Scenario: AI/ML in General Ledger – Anomaly Detection, Auto-Coding & Forecasting
🔢 Stage | 📌 Purpose | 🔷 Azure Services | 🟧 AWS Services |
---|---|---|---|
📥 1. Data Ingestion | Ingest journal entries and accounting data from ERP systems | Azure Data Factory, Azure Blob Storage, Azure Event Grid | AWS Glue, Amazon S3, Amazon Kinesis |
🧹 2. Data Preprocessing | Cleanse, normalize, and transform GL transactions | Azure Synapse, Azure Data Lake, Azure Functions | AWS Glue, AWS Lambda, Amazon Athena |
🔖 3. Feature Engineering | Create features like account frequency, transaction patterns, and control flags | Azure Machine Learning (Designer or Notebooks) | Amazon SageMaker Feature Store |
🤖 4. Model Training | Train ML models to classify typical vs atypical postings | Azure Machine Learning (AutoML, Notebooks, Pipelines) | Amazon SageMaker (AutoPilot, Notebooks, Training Jobs) |
🚀 5. Model Hosting | Deploy anomaly detection models as APIs | Azure ML Endpoints, Azure Kubernetes Service (AKS) | SageMaker Endpoints, AWS Lambda + API Gateway |
🧠 6. Real-time Inference | Flag anomalies or inconsistencies during journal posting | Azure Event Hubs, Azure Functions, Cosmos DB | Amazon Kinesis, Lambda, DynamoDB |
📊 7. Visualization | Present flagged entries and risk scores to finance team | Power BI, Azure Static Web Apps | Amazon QuickSight, AWS Amplify |
🔐 8. Security & Audit | Ensure secure access, audit logs, and data integrity | Azure Key Vault, Microsoft Defender, Azure Policy | AWS KMS, AWS IAM, AWS CloudTrail |
📈 9. Monitoring & Feedback | Monitor model performance, retrain with new data | Azure Monitor, Application Insights, Azure ML Metrics | Amazon CloudWatch, SageMaker Model Monitor, AWS X-Ray |