textattack.metrics package

metrics package: to calculate advanced metrics for evaluting attacks and augmented text

• textattack.metrics.attack_metrics package
  • attack_metrics package:
  • Metrics on AttackQueries
  • Metrics on AttackSuccessRate
  • Metrics on perturbed words
• textattack.metrics.quality_metrics package
  • Metrics on Quality package
  • Perplexity Metric:
  • USEMetric class:

Metric Class

class textattack.metrics.metric.Metric(**kwargs)

Bases: abc.ABC

A metric for evaluating Adversarial Attack candidates.

abstract calculate(results)

Abstract function for computing any values which are to be calculated as a whole during initialization :param results: Attack results for each instance in dataset :type results: AttackResult objects