Custom scanner guide

The Genius Scan SDK enables application developers to add a scanning module taking benefit of the power of the same technology embedded in the Genius Scan app.

The Core and the OCR modules of the SDK allow to add a fully customizable scan flow to any native app.

The Core module provides:

  • Document processing algorithms, which apply image treatment to image objects.
  • A PDF generator to create a PDF document from the processed images.
  • UI elements that help build the main screens of a scanning application.

Prerequisites

This guide assumes that you have followed the Getting Started guide :

  • You have integrated the gssdk-core (and optionally, gssdk-ocr) library in your app with Gradle.
  • You have initialized the SDK with the license key.

Document Processing Algorithms

We’ve split the document processing operations into two classes: DocumentDetection which mainly handles the real-time document detection on the camera previewm, and ScanProcessing which applies various image processing algorithms such as perspective correction and filters to a single scan.

Document detection

The edge detection takes in an image and returns a quadrangle representing the four corners of the detected document.

Kotlin
val documentDetection = CnnDocumentDetection(context)
val quadrangle = documentDetection.detectDocument(imageToAnalyzePath)
Java
DocumentDetection documentDetection = new CnnDocumentDetection(context);
Quadrangle quadrangle = documentDetection.detectDocument(imageToAnalyzePath);

Scan processing

The ScanProcessing class takes an image as input and a list of operations to apply to this image. It returns the processed image, as well as which treatments it performed.

You can apply the following operations to an image:

  • Perspective correction
  • Curvature correction
  • Document enhancement
Kotlin
val scanProcessor = ScanProcessor(context)

// If the detection was already applied, we have a quadrangle:
val quadrangle;

val configuration = Configuration(
  PerspectiveCorrection.withQuadrangle(quadrangle),
  CurvatureCorrection.automatic(),
  Enhancement.automatic()
)

val outputParameters = scanProcessor.process(imageToProcessPath, processedImagePath, configuration)
Java
ScanProcessor scanProcessor = new ScanProcessor(context);

// If the detection was already applied, we have a quadrangle:
Quadrangle quadrangle;

Configuration configuration = new Configuration(
  PerspectiveCorrection.withQuadrangle(quadrangle),
  CurvatureCorrection.automatic(),
  Enhancement.automatic()
);

OutputParameters outputParameters = scanProcessor.process(imageToProcessPath, processedImagePath, configuration);

PDF generation

The PDF generation module provides a couple objects to generate a PDF file.

PDF Page

An object wrapping the information to create a PDF page.

Kotlin
val page = PDFPage(imageFilePath, PDFSize(8.27f, 11.69f))
Java
PDFPage page = new PDFPage(imageFilePath, new PDFSize(8.27f, 11.69f));

PDF Document

A PDF document representing a collection of PDF pages.

Kotlin
val document = PDFDocument(title, password, keywords, listOf(pages1, page2))
Java
PDFDocument document = new PDFDocument(title, password, keywords, Arrays.asList(pages1, page2));

PDF Generator

The generator takes in a PDFDocument object, and writes the corresponding PDF file.

Kotlin
val generator = PDFGenerator.createWithDocument(document, null, null)
generator.generatePDF(outputFilePath)
Java
PDFGenerator generator = PDFGenerator.createWithDocument(document, null, null);
generator.generatePDF(outputFilePath);

UI components

Live Capture Screen

The “capture” view displays a camera preview. It takes care of setting up the entire camera stack for you. The view comes free of buttons or any UI element so that you can design it as you want. You will need to take care of this in your implementation.

You will need to include the ScanFragment into an Activity that implements the ScanFragment.CameraCallbackProvider. You can refer to the ScanActivity class in the CustomDemo application for an example.

To enable or disable live document detection, use the method scanFragment.setRealTimeDetectionEnabled. And to implement auto trigger or react based on document detection events, set a listener and implement the callbacks with scanFragment.setBorderDetectorListener.

Edit Frame Screen

The edit frame screen lets the user adjust the auto-detected edges of a document.

You subclass the BorderDetectionImageView and include it into an Activity layout. You can refer to the BorderDetectionActivity class in the CustomDemo application for an example.

Text Recognition (OCR)

The OCR module provides a way to extract text and its layout from scanned images. The extraction outputs the text in 2 different formats: raw text and XML containing both the text and its layout (also called hOCR). It’s then possible to generate a PDF document using this information to make it searchable and selectable.

Extract text from images

Text Recognition relies on the Tesseract library and needs training data files on the mobile device. Training data files are specific for each language in which text needs to be recognized and are available on this page. You have to place them in a directory named tessdata on the device.

Kotlin
val ocrConfiguration = OcrConfiguration(listOf("eng"), tessdataDirectory, false)

val result = ocrProcessor.processImage(image, ocrConfiguration, progressListener)

val xmlTextLayout = result.textLayout
Java
OcrConfiguration ocrConfiguration = new OcrConfiguration(Arrays.asList("eng"), tessdataDirectory, false);

OcrResult result = ocrProcessor.processImage(image, ocrConfiguration, progressListener);

String xmlTextLayout = result.textLayout;

Generate PDF document with text

PDF generation allows a text layout to be provided for each page of the document.

Kotlin
val page = PDFPage(image.getAbsolutePath(), A4_SIZE, xmlTextLayout)
// Generate PDF
Java
PDFPage page = new PDFPage(image.getAbsolutePath(), A4_SIZE, xmlTextLayout);
// Generate PDF

© 2020 The Grizzly Labs, Inc. All rights reserved.