TrojAI is developing solutions to protect artificial intelligence platforms from adversarial attacks on training data and AI models, such as poisoning or embedded Trojan and evasion attacks. Focused on computer vision platforms, the data transformation and model monitoring techniques developed by TrojAI not only aid in the defence against such attacks, but in some cases also provide incremental improvements in model accuracy and performance. TrojAI’s secure cloud SaaS service also includes a forensically tracked archival repository system to provide customers with a complete solution for peace of mind AI security and brand protection.
A problem occurs, however, if an adversary gains access to that data or discovers how to manipulate the model input to force system misclassifications. Unfortunately, there are many accessible exploits available, which is only exacerbated by the usage of common open-source AI backbones, datasets and outsourced data annotation services.
Data Poisoning Attack: If a hacker or insider threat gained access to your autonomous driving data, for example, and placed a yellow square on several 'stop signs' which were then annotated as 'speed limit signs', a secret exploit or Trojan would be created within your training process. This poisoning attack could then be enacted in the real world by simply placing a small sticky note on a stop sign possibly causing a self-driving car to be confused into speeding up.
Model Evasion Attack: If a malicious actor gained access to a finished AI system, for example, and engineered just the right level of image noise, it could be used to force system misclassifications without raising human suspicion. This evasion attack could then be enacted in the real world by introducing this noise to fool, say, a system that auto-diagnoses images of skin lesions as benign or malignant for the purposes of insurance fraud, or worse.
Protect against insider threats by using TrojAI as your trusted data custodians. Data is securely stored on leading cloud services within country of origin and is forensically tracked to ensure that it remains unchanged using provenance versioning.
Continuously scan AI assets and quantify how susceptible your AI is to adversarial attack. Enjoy peace of mind as our continuously improved defences keep you ahead of emerging attack vectors to reduce and track risk over time.
Many adversarial defense techniques can reduce attack risk while significantly improving model accuracy by normalizing certain types of noise in your data. Hard to believe? Contact us today and see for yourself.
Stay ahead of malicious actors by evaluating your entire AI pipeline using white, black and grey-box penetration testing to highlight unintended model behaviours that traditional cybersecurity practices miss.
Receive actionable monthly updates highlighting unexpected network activations, improvements in risk level and expected accuracy gains found during our continuous automated monitoring of your AI data and models.
Your success and brand trust depends on keeping your innovations and customers safe. TrojAI provides peace of mind by protecting your AI assets and keeping you ahead of malicious actors.
40 Charlotte St
Saint John, NB
Phone: (+506) 333-7207