Deep Learning for Manufacturing Schedule Optimization

Introduction

Developing Manufacturing 4.0 capabilities does not obviously happen overnight. A lot of groundwork needs to be done to create the foundational infrastructure.  However, that should not stop you from experimenting with pilots to understand what “smart” capabilities can be embedded in your Manufacturing network.

Irrespective of whether you are a manufacturing entity or a consulting entity looking to develop capabilities in Manufacturing 4.0, the key is to start exploring and building a roadmap accordingly. This article provides an example of an opportunity area you can explore-job shop scheduling.

Though optimization heuristics are commonly used in job shop scheduling, I see these prescriptive algorithms becoming legacy in a Manufacturing 4.0 era where there will be little to no room for latency. I firmly believe deep learning will be an excellent fit for analytics in Manufacturing 4.0 environment. While this proposed solution is for setup time minimization only, a “Master Algorithm” can be created to optimize other aspects of the manufacturing process. We will discuss that architecture in a separate article.

Current Approaches

Legacy approach

Most manufacturing operations try to minimize setup time by sequencing the parts with other parts with standard geometry and tool requirements. This form of sequencing is inflexible, and though it reduces setup time, it is not satisfactory as far as responding to customer demand pattern fluctuations go. While many attempts have been made to minimize the cost or cycle time of Job shop manufacturing, those addressing the issue of setup waste while meeting customer on-time demand are rare.

Job Shop Scheduling (JSM) approach

JSM approaches are widely leveraged for shop scheduling, notably the Shortest Processing Time (SRT) heuristics.

SRT Heuristics:  Assume that the part number with the lowest total setup time plus machining time is denoted as P1, the second lowest is P2, and so on. Then run the parts in the sequence P1<=P2…..<=Pn. This will result in the lowest average, or mean, delivery cycle time.

This heuristics also did not address the customer service issue. While this method may result in a lower mean cycle time, it may also result in part N in the sequence being produced last, even though it may be required first. However, you can run variations of SRT with additional constraints, where multiple interpretations of JSM  are run. But realistically, you will not have

The Neural Network Approach

Problem Statement

We need to find the sequence of producing parts that will replace the wasteful random setups, resulting in a 50-70% reduction of setup time while still meeting customer delivery dates.

Inputs

  1.  List all jobs and part numbers at each Pull group, all of which must be shipped within 30 days.
  2. A matrix of setup times from any part number to any other part number.
  3. The setup time data on tools, chucks, etc., on the machine within 3 hours of finishing its machining task. The 3-hour deadline will allow us to respond to any new job.

Creating Training Data and Why Heuristics Won’t Work

Theoretically, the solution to this problem is similar to TSP heuristics. So, for example, there are four parts, A, B, C, and D. The logic considers these setup times as “distance between these cities” and hence can leverage the logic of “visiting several cities” in a sequence that minimizes the distance, subject to the customer demand requirement constraints.

Remember that there is no mathematical formula that solves this problem. An iterative approximation can be found using Branch and Bound (B&B). Since we assume a 3-hour deadline (in Inputs),  B&B may be too time-consuming.

So to generate the training data that the NN model will see, we need to create several thousand B&B or TSP Heuristics solutions to unexpected problems ( can be done offline in the cloud using data from the ERP system).

Training the Neural Network

These solutions are then used to train the Neural Network. The training process will adjust the weight of each neuron such that its output on the four job numbers is the same as the offline cloud solution. Thus when presented with a similar set of jobs in the future, the Neural Network will calculate the answer in minutes. The trained Neural Network can see every possible sequence of thousands of parts and finds the one that minimizes total setup time based on its training using Branch and Bound examples.

Those of us who frequently solve optimization problems know that it takes much computing time to reach the objective function’s absolute maximum. Still, you can get to 95% very quickly; in most cases, this 95% is sufficient. The same is true of Neural Networks.

Validate through simulation

A final verification for each recommendation can be done through a simulation program. Most manufacturing operations generally have such models set up already, and running them through these simulations will make sure that Neural Network training is current.

The bridge between theory and Implementation

While theoretically, the logic seems straightforward; the natural world has challenges. And the central part of that challenge is not the Neural Network algorithm. The first challenge is to understand where you want to implement this capability. Some of the questions that you need to address here are:

(1) Where will the algorithm sit within the Manufacturing planning systems landscape? How will the information get consumed?

(2) Is the data consistency and integrity in place to support training such a model?

(3) Will the capability require to build such a model be developed internally, or will an external partner help you?


3 responses to “Deep Learning for Manufacturing Schedule Optimization”

  1. Building Differentiating Capabilities with IoT-Enabled Manufacturing Systems – Designed Analytics BLOG Avatar

    […] As you can assume, classic optimization models will not work for either of the two segments. And the reason is embedded in the term “real-time.” As I have highlighted in articles like this, tactical use of optimization models is challenging, specifically in real-time scenarios. And this is where you can leverage deep learning. An example of real-time production sequencing using deep learning can be found in this article. […]

    Like

  2. Why Lean Principles Need to Evolve for Manufacturing 4.0 – Designed Analytics BLOG Avatar

    […] I write about applications of Deep Learning in Manufacturing frequently on this blog. In one of my posts, I provided my perspectives on how Neural Networks can significantly reduce setup times. NNs can […]

    Like

  3. Neural Networks for Supply Chain Design – Designed Analytics BLOG Avatar

    […] have suggested leveraging deep learning in tandem with optimization models in articles like this one for tactical modeling. But supply chain design was not an area I contemplated or experimented […]

    Like

Leave a reply to Why Lean Principles Need to Evolve for Manufacturing 4.0 – Designed Analytics BLOG Cancel reply