Data Analyzer

When we have a dataset on hand, it is often of our interest to run a quick analysis and get some insights. The analysis usually includes making predictions of a new dataset, grouping records, identifying important features, and optimization. We can achieve these goals by building a machine learning model and use the trained model…

May 22, 2024 | by

Study of Machine Learning Parameters for Robustness

NOTE: Robustness reported in this article is being revised with corrections in derivative calculations. Updated results will be published shortly from these corrections. Introduction A natural approach of understanding an unknown model is to get some sample points from the model and use these points to build a response surface model (RSM) to represent the…

April 29, 2024 | by

Apply Simulated Annealing on a curve to find the optimum

Similar to the dataset_simulated_annealing_optimizer worker, which takes a dataset as input, we can consider the curve_simulated_annealing_optimizer worker. It takes a curve as input and returns the optimal y value of the curve as output. A curve can be considered as a dataset with two columns with each representing one coordinate of the points on a…

April 26, 2023 | by

Simulated Annealing with Polynomial Regression

Simulated annealing Simulated annealing is an optimization method to find the global optimum of the objective function. It is inspired by the process of metal annealing which heats the metal to a very high level and cools down in a controlled manner. In the SA algorithm, a random point is selected to start with. A…

April 21, 2023 | by

Compare curves with Dynamic Time Warping

Given two curves, a baseline and a candidate curve, how do we know how similar they are to each other? In machine learning, it is common to compare the predicted values (candidate curve) of a testing set to the true values (baseline curve) by RMSE (Root Mean Square Error). By comparing RMSE values of different…

February 27, 2023 | by

Choose Machine Learning Models With Cross Validation

Machine learning techniques (https://www.d3view.com/introduction-and-application-of-d3view-ml/) are becoming unprecedentedly popular. And it plays an important role in data analysis. It is critical to find the model that demonstrates the best performance. Intuitively, we can build a few different models with the data given and see which model gives the best score, either it being RMSE (root mean…

February 20, 2023 | by

Multi-objective optimization with Pareto front

Optimization Decisions are made based on preferences. Either it is to minimize the monthly expense for a person living with a tight budget or to maximize the revenue of a restaurant for a business owner, we need to consider our preference or criteria (minimize or maximize) to form a solution. This process is called optimization…

September 23, 2022 | by

Kriging interpolation

In the previous post, we have discussed about how interpolation works in general and reviewed a few commonly used interpolation methods. All these methods only consider the adjacent a few points. This works fine most of the time. However, in reality, data points further away from the interpolation point may also have some impact on…

September 20, 2022 | by

Curve reconstruction procedure for use in Machine Learning

Introduction Given a set of points, we want to construct a curve that shares some specific patterns described by a group of curves. From the description of the problem, there are two pieces of information available to us. First, the points available (Prediction Points) are part of an unknown curve we want to reconstruct. Second,…

August 10, 2022 | by

Introduction and Application of d3VIEW-ML

Machine learning is a data analysis technique that builds a model with the data and uses the model to predict. It learns from the data, identifies patterns and produces reliable predictions that help with decision making. As modern computational techniques advance, machine learning becomes more and more popular. There are two major groups of learning…

July 21, 2022 | by