From 578d91062ba6724d904526044f3d38da20f10554 Mon Sep 17 00:00:00 2001 From: Dmitry Volodin Date: Wed, 1 Apr 2020 15:39:48 +0300 Subject: [PATCH 1/2] NOC 20.1 Release Notes --- docs/src/en/releases/index.rst | 1 + docs/src/en/releases/noc-upcoming.rst | 2 - docs/src/en/releases/release-19.4.rst | 3 + docs/src/en/releases/release-20.1.rst | 879 +++++++++++++++++++++++++- 4 files changed, 876 insertions(+), 9 deletions(-) diff --git a/docs/src/en/releases/index.rst b/docs/src/en/releases/index.rst index b362aba739..d7468001d8 100644 --- a/docs/src/en/releases/index.rst +++ b/docs/src/en/releases/index.rst @@ -7,6 +7,7 @@ Releases :glob: /releases/noc-upcoming + /releases/noc-20 /releases/noc-19 /releases/noc-18 /releases/noc-15 diff --git a/docs/src/en/releases/noc-upcoming.rst b/docs/src/en/releases/noc-upcoming.rst index 6317436e31..ef049454fa 100644 --- a/docs/src/en/releases/noc-upcoming.rst +++ b/docs/src/en/releases/noc-upcoming.rst @@ -6,5 +6,3 @@ Upcoming Releases .. toctree:: :titlesonly: - - /releases/release-20.1 diff --git a/docs/src/en/releases/release-19.4.rst b/docs/src/en/releases/release-19.4.rst index 16a1077780..8248643ba8 100644 --- a/docs/src/en/releases/release-19.4.rst +++ b/docs/src/en/releases/release-19.4.rst @@ -21,6 +21,9 @@ bugfixes, optimisations and improvements. Highlights ---------- + +.. _release-19.4-py3: + Python3 Compatibility Statement ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Python3 compatibility was one of primal focuses during 19.4 release cycle. diff --git a/docs/src/en/releases/release-20.1.rst b/docs/src/en/releases/release-20.1.rst index 8027e96bfc..c381e0bb87 100644 --- a/docs/src/en/releases/release-20.1.rst +++ b/docs/src/en/releases/release-20.1.rst @@ -4,12 +4,877 @@ NOC 20.1 ======== -.. contents:: On this page - :local: - :backlinks: none - :depth: 1 - :class: singlecol +In accordance to our :ref:`Release Policy ` +`we're `_ proudly present release `20.1 `_. -.. warning:: +20.1 release contains `254 `_ bugfixes, optimisations and improvements. - Upcoming release +.. _release-20.1-highlights: +Highlights +---------- + +.. _release-20.1-py3: + +Python3 Compatibility +^^^^^^^^^^^^^^^^^^^^^ + +As it was declared in :ref:`Python3 Compatibility Statement`, +20.1 is the first release which offers full py3 compatibility. Python +version can be selected in the Tower interface during deploy. + +Following Python versions are used: + +* 2.7 for py2 installations +* 3.6 for py3 installations + +You should stay on py2 if: + +* CLIPS-based config config validation is used. You're urged to move + to the ConfDB based validation engine. +* `custom` is used. You have to check custom code base for py3 compatibility + with tools like `2to3` and `futurize`. It is advised to check results + on separate test installation. +* `pyrules` are used. Just in case with `custom` you have to perform + additional compatibility checking and testing is required. +* You have very personal reason to stay on py2. + +All other installation should be deployed in py3 mode. + +Please note that Python 3.7+ compatibility cannot be reached just now +due to dependencies restriction. Reaching latest stable python version +compatibility is still work in progress. + +Returning to :ref:`Python3 Compatibility Statement` - +we're starting to remove py2 compatibility code and testing infrastructure +in order to clean our codebase. NOC 20.2 will be py3-only release. + +.. _release-20.1-rust: +Rust infrastructure +^^^^^^^^^^^^^^^^^^^ + +NOC beginning to adopt `Rust `_ as a +viable component of its infrastructure. Rust is blazingly fast and +memory-effective language for building reliable software. Common motivation +behind the Rust: + +* No language-integrated GC, so it integrates well with Python + via `PyO3 `_ bindings. Rust can fully replace + Cython in the NOC project. Following parts of system can gain + great benefit from Rust: + + * ASN.1 BER decoder (SNMP Operation) + * IP Address manipulation + * HTTP Client + +* Can be used to build high-performance existing part of the system: + + * ping + * chwriter + * syslogcollector + * trapcollector + +* Can be used to build like new perspective components like: + + * flowcolletor + * cdrcollector + +* Can be used to write standalone components, like server agents + +Though some part of Rust usage held by py3 transition (pyo3 supports Python 3.5+), +we're expecting to remove all obstacles in 20.2 release. + +We're already rewritten DNS Synchronization component from Go language +to Rust. + +.. _release-20.1-collator: +Physical to Logical Interface Mapping +^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + +New mechanism called `Collator` has been introduced. Collator establishes +connection between logical interface (ManagedObject Interface) +and hardware slot bound to inventory model. So it is possible to answer the questions: + +* Where particular interface is physically located? +* Has the particular interface any hardware restrictions? +* Which logical port corresponds to the physical slot? +* Which logical ports are served by given hardware module? + +.. _release-20.1-composite: +Composite Connections +^^^^^^^^^^^^^^^^^^^^^ +Inventory support for composite connections has been added. +Composite connections are physical jacks serving several ports at once. +Most known cases are RJ-21/mRJ-21, CENC-36M. +Composites are just bundle of pins assigned to several internal connections. + +.. _release-20.1-cpe: +NVD CPE +^^^^^^^ +Inventory support for `NVD CPE `_ identifiers +has been added. NOC supports CPE v2.2 and v2.3 inventory attributes. +NVD CPE identifiers allow to use NOC in security audit process. + +.. _release-20.1-serial-checking: +Serial Number Checking +^^^^^^^^^^^^^^^^^^^^^^ +Additional inventory model attributes for serial number validity +checking has been introduced. Minimal and maximal length of +serial number and regular expression pattern can be set. + +Binary, broken and non-unique serial numbers are headache on +cheap optical modules, so it is good idea to drop obviously +crap serial and fallback to NOC-generated ones. + +.. _release-20.1-find-serial: +./noc inventory find-serial command +^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ +Handy `find-serial` cli command has been added. It is possible +to search for one or more serials from common line and see, +where this module is located. + +.. _release-20.1-display-hints: +SNMP Display-Hints +^^^^^^^^^^^^^^^^^^ +SNMP Display-Hints are the first-class citizens. So NOC tries to +decode binary OctetString data to the readable textual representation, +if defined by MIB or set manually during the function call. + +.. _release-20.1-taskmon: +Task Monitor +^^^^^^^^^^^^ +UI to control discovery jobs has been added. + +.. _release-20.1-fm-pool: +FM Pools +^^^^^^^^ +Now it is possible to separate Managed Object's SA and FM pool binding. +Possible cases are: + +* Intersecting address space within single segment +* Eliminating the need to allocate separate classifier/correlator + processes for small SA pools. + +.. _release-20.1-getmappings: +NBI getmappings API +^^^^^^^^^^^^^^^^^^^ +NBI API to query object mappings has been introduced. Mappings are +relations between identifiers in NOC and in the remote systems. +Consider NOC loads Managed Object from external network inventory system (NRI) +via ETL process. NRI has own ID for the object (remote id), while NOC assigns its own (local id). +So mapping is the relation between NOC's ID, and the pairs of +(Remote System, Remote ID). + +`getmappings` API allows to query objects by local or remote id and +to get all known mappings in the single call. + +.. _release-20.1-protected-fields: +Protected Fields +^^^^^^^^^^^^^^^^ +Some fields in UI can be marked as `protected`, preventing manual +user changes. + +Development Process Changes +--------------------------- + +Towards Monorepo +^^^^^^^^^^^^^^^^ +We're beginning to collect all NOC-related repositories to a single repo. +Following repos have been merged: + +* collections +* noc-sync-bind + +Flake8 Checks +^^^^^^^^^^^^^ +Codebase is clean enough to enforce previously disabled flake8 check, +so they are mandatory now: + +* F403 - 'from xxx import *' used; unable to detect undefined names +* F405 - 'xxx' may be undefined, or defined from star imports: xxx +* W605 - invalid escape sequence 'x' + +Pending Deprecations +-------------------- +CLIPS-based configuration validation is not supported on python3 installations +and will be removed in NOC 20.2. Please select Python 2 if you have +config validation rules and consider to rewrite them to ConfDB validation +queries or your installation may be stuck on NOC 20.1 release. + +.. _release-20.1-features: +New features +------------ ++------------+---------------------------------------------------------------------------+ +| MR | Title | ++------------+---------------------------------------------------------------------------+ +| :mr:`811` | Add Task Monitor | ++------------+---------------------------------------------------------------------------+ +| :mr:`2753` | Add Open/Close Events from Thresholds | ++------------+---------------------------------------------------------------------------+ +| :mr:`2952` | noc/noc#1150 Add protected fields to web application backend. | ++------------+---------------------------------------------------------------------------+ +| :mr:`3063` | Lazy MIB loading | ++------------+---------------------------------------------------------------------------+ +| :mr:`3082` | noc/noc#1221 snmp display-hint processing | ++------------+---------------------------------------------------------------------------+ +| :mr:`3090` | noc/noc#1110 Add composite connection. | ++------------+---------------------------------------------------------------------------+ +| :mr:`3103` | noc/noc#1111 Add combo field to objectmodel for Combined connection type. | ++------------+---------------------------------------------------------------------------+ +| :mr:`3115` | Add single ddash for interfaces in card | ++------------+---------------------------------------------------------------------------+ +| :mr:`3179` | Rust infrastructure | ++------------+---------------------------------------------------------------------------+ +| :mr:`3214` | #1219 Additional topology information in managedobject datastream | ++------------+---------------------------------------------------------------------------+ +| :mr:`3225` | nbi: getmappings API | ++------------+---------------------------------------------------------------------------+ +| :mr:`3235` | Interface type 'internal' | ++------------+---------------------------------------------------------------------------+ +| :mr:`3297` | #1264 confdb: meta matchers section | ++------------+---------------------------------------------------------------------------+ +| :mr:`3307` | #1269: Physical port to logical interface binding | ++------------+---------------------------------------------------------------------------+ +| :mr:`3311` | installation_id and globally-unique bi_id generation | ++------------+---------------------------------------------------------------------------+ +| :mr:`3312` | #1255 FM Pools | ++------------+---------------------------------------------------------------------------+ +| :mr:`3324` | #1277 asset: Serial numbers checking | ++------------+---------------------------------------------------------------------------+ +| :mr:`3335` | ./noc inventory find-serial command | ++------------+---------------------------------------------------------------------------+ + + +.. _release-20.1-improvements: +Improvements +------------ ++------------+-----------------------------------------------------------------------------------------------+ +| MR | Title | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`2991` | Fix Cisco Nexus version detection | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3006` | Fix Eltex.LTE.get_inventory script | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3040` | managedobject datastream: `admin_status` field | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3067` | mib: Resolve syntax references | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3070` | Speedup find service on etl load. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3072` | `./noc sync-mib` speedup | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3073` | Add extra_vars params to pm dash | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3074` | ./noc compile-mib is moved into ./noc mib make-collection | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3075` | Allow to import MIBs in BIG5 encoding | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3088` | inv.objectmodel remove renderer on protocols column | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3099` | Add query param to confdb command. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3100` | Rebuild datastream when object or objectconnection change. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3110` | Add make collection from directory to mib command. Fix decode error on compile mib API. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3122` | Add iface threshold profile handler | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3139` | Interface threshold handling fixes | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3148` | noc/noc#1085 Confdb add VRRP. initial version. Add cisco, huawei | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3158` | Add queue params to close_tt and add_comment method on TT adapter. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3159` | noc/noc#1184 IGetAlarms SA interface. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3166` | Fix ldap auth for ldap3 verison 2.0.9-2.6.1 (Py3) | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3168` | Add promote_affected_tt param to AlarmEscalation config. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3169` | noc/noc#1245 Move configvalidation umbrella to 'Config | Object Policy Violation' AlarmClass. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3171` | Add escalate umbrella alarm. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3187` | Update Search by MAC in MO Inteface | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3202` | #1203 Span.set_error, .set_error_from_exc helpers | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3206` | Replace get_handler on classifier service. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3215` | ./noc datastream rebuild --jobs | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3217` | Add docs for optical model interface | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3220` | Add docs for cpe part of asset model interface | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3232` | #1263 bi managedobject: full link methods detalization | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3234` | test snmp_metrics json | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3236` | noc/noc#1087 ConfDB. add meta chassis_id | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3238` | JUnit XML test report | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3242` | check-labels: JUnit XML report | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3244` | ConfDB: vrrp. add preempt | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3248` | pymongo 3.10.1 | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3253` | rust project label | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3254` | mongoengine 0.19.1 | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3255` | noc/noc#1078 datastream: config section of managedobject datastream | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3262` | flake8 JUnit XML report | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3279` | Reworked collection JSON sharing | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3293` | inv.objectmodels collection tests | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3295` | Add 'Config | Policy Violations' alarm class. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3304` | box: move asset discovery just after config one | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3305` | Fix service mailsender | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3309` | test collections' uuids for uniqueness | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3313` | check-labels: Fix migration label detection | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3314` | Retry check-labels as the labels will be fixed from webhook | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3320` | Activate collections tests | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3322` | add new report - load metric max | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3323` | Fix report load metrics | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3328` | check-labels: Detect `collections` label | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3329` | DCS: Stop one-time resolvers | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3330` | #1191 scheduler: Gracefully apply pending bulk operations on shutdown | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3333` | managedobject datastream: Interface services | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3339` | Catch IOError exception on beef load. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3353` | Raise error when OID tree from beef end. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3354` | Add display_hints options to get_table script method. | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3355` | Restore ujson-x 1.37 | ++------------+-----------------------------------------------------------------------------------------------+ +| :mr:`3366` | #1278 sae: Pass `attributes` section | ++------------+-----------------------------------------------------------------------------------------------+ + + +.. _release-20.1-bugs: +Bugfixes +-------- ++------------+------------------------------------------------------------------------------------------------------+ +| MR | Title | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`2879` | Fix Exception when send message 'ServiceStub' object has no attribute 'pub' | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3013` | #1186 py3: Fix request.body processing | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3014` | #1185 py3: Fix error reporting on missed custom modules | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3015` | Fix cleanup 0192_thresholdprofile migration. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3019` | Fix 0153_managedobjectselector_profile migration after fix 0150_managed_object_profile migration. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3024` | noc/noc#1195 Catch ValueError when convert_interface_name on TopologyDiscovery. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3024` | noc/noc#1195 Catch ValueError when convert_interface_name on TopologyDiscovery. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3029` | py3: alnum_key() for reliable sorting | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3034` | Fix TypeError on http client when working over proxy. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3037` | #1193 py3: Fix MRT service | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3041` | #1201 py3: Fix http client `eof_mark` handling | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3045` | #1196 py3: Fix location handling | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3047` | #1209 Fix syslogcollector/trapcollector port binding | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3055` | Fix CH objectprofile datasource bool field. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3055` | Fix CH objectprofile datasource bool field. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3062` | noc/noc#1197 Fix encoding on interfacepath card. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3064` | py3 fix beef import encoding. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3066` | Add getting Job log to SA Monitor application | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3068` | fix Alstec, Eltex pon/rg, qsw8200, dlink get_inventory | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3069` | py3: Fix `sync-mibs` | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3078` | Fix typo in text parse_table on row_wrapper param check. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3093` | fix ReportAlarmDetail | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3094` | noc/noc#1188 Fix memory leak on SSH CLI. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3097` | noc/noc#1096 Fix correlator trigger handler call. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3104` | noc/noc#1213 py3. Fix TypeError when collected config convert to binary. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3137` | Fix MAC AutoAPI doc builder | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3143` | Fix object datastream iter_changed managed_object check. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3152` | Fix object iter_changed_datastream typo. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3161` | Fix Segment MAC Discovery when the object links to itself | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3162` | Fix interface_flap field on ReportMetrics. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3178` | Fix import __future__ print in deploy scripts | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3184` | Fix promote_affected_tt param when escalation item. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3201` | sa.managedobject: Remove duplicated LAG Profile column | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3205` | Fix delay escalation when start time < now time | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3207` | #1227: Filter out duplicated metric measurements | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3221` | Rebuild credential cache when change ManagedObjectProfile beef_storage and beef_path_template field. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3224` | py3: Fix nbi service logging | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3230` | Fix typo in etl extractor. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3239` | Fix Test notification group, when id > 9. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3247` | Add ldap3 escape filter chars | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3250` | #1267 Fix Peer.save() | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3258` | py3: Fix whois client | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3259` | #1210: Better json content type handling | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3263` | Add MO queue for maintenance escalation | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3267` | Fix Alarms class filter | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3288` | Fix VRF type name to lowercase (were changed on interface). | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3291` | Add raise_privileges and access_preference params when call login script on suggestcli discovery. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3303` | inv.objectmodels: Fix duplicated uuids | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3327` | Fix typo max_serial_size on asset discovery. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3356` | py3: Fix cli.object_stream | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3358` | py3: Fix name encoding when calculate config diff. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3359` | Convert cmd_next and cmd_stop to bytes on object_cli parser. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3371` | #1280 py3 ConfDB: Fix node sorting | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3373` | py3: Fix adaptive prompt pattern | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3374` | py3: Fix telnet sb/se logging | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3376` | py3: Clean ETL loader stream from unreadable characters | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3379` | Add fm_pool to field managed object loader. | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3381` | py3: Fix Selectors over attributes | ++------------+------------------------------------------------------------------------------------------------------+ +| :mr:`3384` | Fix NRI discovery | ++------------+------------------------------------------------------------------------------------------------------+ + + +.. _release-20.1-cleanup: +Code Cleanup +------------ ++------------+-------------------------------------------------------------------+ +| MR | Title | ++------------+-------------------------------------------------------------------+ +| :mr:`3036` | noc/noc#1198 Fix AlarmDiagnostic.get_diagnostics encode. | ++------------+-------------------------------------------------------------------+ +| :mr:`3053` | Update docs/src/en/services/icqsender.rst | ++------------+-------------------------------------------------------------------+ +| :mr:`3060` | Fix activator.http_get decode error. | ++------------+-------------------------------------------------------------------+ +| :mr:`3061` | noc/noc#1197 Fix sortdict on managedobject card. | ++------------+-------------------------------------------------------------------+ +| :mr:`3071` | py3. Fix MIBAPI service. | ++------------+-------------------------------------------------------------------+ +| :mr:`3102` | LLDP-MIB render test | ++------------+-------------------------------------------------------------------+ +| :mr:`3107` | Update requirements/deploy scripts for py3/py2 compat | ++------------+-------------------------------------------------------------------+ +| :mr:`3138` | Links to MR list | ++------------+-------------------------------------------------------------------+ +| :mr:`3195` | py3. Not encoding utf-8 on geocodercache. | ++------------+-------------------------------------------------------------------+ +| :mr:`3200` | noc/noc#1250 Fix ETL for py3. | ++------------+-------------------------------------------------------------------+ +| :mr:`3204` | noc/noc#1256 Fix future.set_exception_info on threadpool for py3. | ++------------+-------------------------------------------------------------------+ +| :mr:`3208` | Remove 20.1 deprecations | ++------------+-------------------------------------------------------------------+ +| :mr:`3209` | Bump pynsq version to 0.8.3 | ++------------+-------------------------------------------------------------------+ +| :mr:`3216` | Code formatting | ++------------+-------------------------------------------------------------------+ +| :mr:`3219` | Fix bytes on script super_username submit. | ++------------+-------------------------------------------------------------------+ +| :mr:`3233` | py3: Fix bi extract | ++------------+-------------------------------------------------------------------+ +| :mr:`3249` | flake8: Enable W605 check | ++------------+-------------------------------------------------------------------+ +| :mr:`3251` | rust: remove "extern crate" | ++------------+-------------------------------------------------------------------+ +| :mr:`3252` | CI: Remove migrate stages | ++------------+-------------------------------------------------------------------+ +| :mr:`3260` | Remove deprecated models and applications | ++------------+-------------------------------------------------------------------+ +| :mr:`3261` | RCA neighbor cache is default and only | ++------------+-------------------------------------------------------------------+ +| :mr:`3264` | ujson 2.0.2 | ++------------+-------------------------------------------------------------------+ +| :mr:`3285` | Merge back collections/ to main repo | ++------------+-------------------------------------------------------------------+ +| :mr:`3286` | Restore tests | ++------------+-------------------------------------------------------------------+ +| :mr:`3296` | flake8: Enable F403 and F405 checks | ++------------+-------------------------------------------------------------------+ +| :mr:`3310` | inv.connectiontypes UUID uniqueueness test | ++------------+-------------------------------------------------------------------+ +| :mr:`3315` | Fix cr_context on model | ++------------+-------------------------------------------------------------------+ +| :mr:`3316` | Replace gender for c14 connection type part1 | ++------------+-------------------------------------------------------------------+ +| :mr:`3317` | Replace gender for c14 connection type part2 | ++------------+-------------------------------------------------------------------+ +| :mr:`3318` | Replace gender for c14 connection type part3 | ++------------+-------------------------------------------------------------------+ +| :mr:`3319` | Replace gender for c14 connection type part4 | ++------------+-------------------------------------------------------------------+ +| :mr:`3336` | py3: mailsender fixes | ++------------+-------------------------------------------------------------------+ +| :mr:`3338` | Fix typo on asset discovery logging. | ++------------+-------------------------------------------------------------------+ +| :mr:`3340` | Replace StringIO to BytesIO on DetailReport for xlsxwriter work. | ++------------+-------------------------------------------------------------------+ +| :mr:`3350` | py3. Fix expected byte trace on interface-profile command. | ++------------+-------------------------------------------------------------------+ +| :mr:`3352` | py3: Convert `rogue_chars` to binary type | ++------------+-------------------------------------------------------------------+ +| :mr:`3357` | py3: Fix if between None and int type. | ++------------+-------------------------------------------------------------------+ +| :mr:`3362` | py3: Disable CLIPS parsers. | ++------------+-------------------------------------------------------------------+ +| :mr:`3365` | Clean data type on Consul config client. | ++------------+-------------------------------------------------------------------+ +| :mr:`3372` | py3: Replace split_alnum to alnum_key on matchers. | ++------------+-------------------------------------------------------------------+ +| :mr:`3375` | py3: Replace decode method to codecs on profiles. | ++------------+-------------------------------------------------------------------+ +| :mr:`3377` | py3: Convert addr and port to bytes on http client. | ++------------+-------------------------------------------------------------------+ +| :mr:`3378` | py3: Convert hash on geocodercache to text. | ++------------+-------------------------------------------------------------------+ + + +.. _release-20.1-profiles: +Profile Changes +--------------- + +.. _release-20.1-profile-Alcatel.7302: +Alcatel.7302 +^^^^^^^^^^^^ ++------------+----------------------------------------------------------------------+ +| MR | Title | ++------------+----------------------------------------------------------------------+ +| :mr:`3089` | Alcatel 7302 fix port_map | ++------------+----------------------------------------------------------------------+ +| :mr:`3123` | fix Alcatel 7302 serial | ++------------+----------------------------------------------------------------------+ +| :mr:`3243` | Alcatel.7302 fix empty b_serial, b_revision. fix port_map. version 2 | ++------------+----------------------------------------------------------------------+ + + +.. _release-20.1-profile-Alsitec.24xx: +Alsitec.24xx +^^^^^^^^^^^^ ++------------+--------------------------------------------------------------------------------------+ +| MR | Title | ++------------+--------------------------------------------------------------------------------------+ +| :mr:`3119` | noc/noc#1181 Alstec.24xx. Fix unknown serial number, and devices with 4413 DeviceID. | ++------------+--------------------------------------------------------------------------------------+ +| :mr:`3128` | noc/noc#1181 Alstec.24xx.get_inventory. Fallback to CLI when unknown SNMP part_no. | ++------------+--------------------------------------------------------------------------------------+ +| :mr:`3144` | Alstec.24xx.get_inventory. Set script prefer to S. | ++------------+--------------------------------------------------------------------------------------+ +| :mr:`3144` | Alstec.24xx.get_inventory. Set script prefer to S. | ++------------+--------------------------------------------------------------------------------------+ + + +.. _release-20.1-profile-Cisco.IOS: +Cisco.IOS +^^^^^^^^^ ++------------+--------------------------------------------------------------------+ +| MR | Title | ++------------+--------------------------------------------------------------------+ +| :mr:`3009` | Update Cisco.IOS profile to support old hardware | ++------------+--------------------------------------------------------------------+ +| :mr:`3173` | Cisco.IOS.get_lacp_neighbors, get_version. Small fixes encoding. | ++------------+--------------------------------------------------------------------+ +| :mr:`3185` | Cisco.IOS.get_lacp_neighbors. Fix rx_sys_id regex. | ++------------+--------------------------------------------------------------------+ +| :mr:`3229` | Cisco.IOS.get_version and get_capabilities cleanup code. | ++------------+--------------------------------------------------------------------+ +| :mr:`3229` | Cisco.IOS.get_version and get_capabilities cleanup code. | ++------------+--------------------------------------------------------------------+ +| :mr:`3237` | Cisco.IOS.get_switchport. Fix getting vlans from SNMP for python3. | ++------------+--------------------------------------------------------------------+ +| :mr:`3342` | Cisco.IOS.get_cdp_neighbors. Replace OID to mib name. | ++------------+--------------------------------------------------------------------+ +| :mr:`3351` | Cisco.IOS.get_inventory. Use matchers instead match. | ++------------+--------------------------------------------------------------------+ + + +.. _release-20.1-profile-DLink.DxS: +DLink.DxS +^^^^^^^^^ ++------------+----------------------------------------------------------------------+ +| MR | Title | ++------------+----------------------------------------------------------------------+ +| :mr:`3091` | Bypass confirmation of firmware upgrade on DGS-1100-10/ME | ++------------+----------------------------------------------------------------------+ +| :mr:`3363` | DLink.DxS. Fix decode on profile. | ++------------+----------------------------------------------------------------------+ +| :mr:`3367` | Dlink.DxS.get_interfaces. Remove decode ascii interface description. | ++------------+----------------------------------------------------------------------+ + + +.. _release-20.1-profile-Dahua.DH: +Dahua.DH +^^^^^^^^ ++------------+--------------------------------------------------------------------------+ +| MR | Title | ++------------+--------------------------------------------------------------------------+ +| :mr:`3142` | Dahua.DH. Fix getting config from RVi web cam. | ++------------+--------------------------------------------------------------------------+ +| :mr:`3174` | noc/noc#1216 Dahua.DH.get_version. Fix script on cam without PTZ module. | ++------------+--------------------------------------------------------------------------+ + + +.. _release-20.1-profile-Eltex.MES: +Eltex.MES +^^^^^^^^^ ++------------+-----------------------------------------+ +| MR | Title | ++------------+-----------------------------------------+ +| :mr:`3155` | add_metrics_SensorStatus_Eltex_MES | ++------------+-----------------------------------------+ +| :mr:`3177` | fix_Environment_Sensor_Status_Eltex_MES | ++------------+-----------------------------------------+ + + +.. _release-20.1-profile-Eltex.MES24xx: +Eltex.MES24xx +^^^^^^^^^^^^^ ++------------+---------------------------------------------+ +| MR | Title | ++------------+---------------------------------------------+ +| :mr:`3007` | Fix Eltex.MES24xx.get_lldp_neighbors script | ++------------+---------------------------------------------+ +| :mr:`3164` | fix_get_lldp_neighbors_Eltex_MES24xx | ++------------+---------------------------------------------+ + + +.. _release-20.1-profile-Generic: +Generic +^^^^^^^ ++------------+---------------------------------------------------------------------------------+ +| MR | Title | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3020` | Generic.get_lldp_neighbors. Strip \x00 symbol on SNMP string. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3023` | Generic.get_capabilities. Use cache value sysObjectID for getting EnterpriseID. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3023` | Generic.get_capabilities. Use cache value sysObjectID for getting EnterpriseID. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3032` | Generic.get_beef. Fix fsm collecting - not collected if get_version first. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3084` | Generic.get_capabilities. Fix bad enterprise id check. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3149` | Generic.get_beef. Catch SNMP error when collected beef. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3218` | py3. Message attribute not supported on Exception. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3348` | Generic.get_switchport. Fix getting vlans on SNMP. | ++------------+---------------------------------------------------------------------------------+ + + +.. _release-20.1-profile-H3C.VRP: +H3C.VRP +^^^^^^^ ++------------+--------------------------------------------------------+ +| MR | Title | ++------------+--------------------------------------------------------+ +| :mr:`3240` | H3C.VRP. Fix get_version and add SNMP scripts. | ++------------+--------------------------------------------------------+ +| :mr:`3300` | H3C.VRP.get_version. Fix regex for S3100-8TP-EI model. | ++------------+--------------------------------------------------------+ + + +.. _release-20.1-profile-Huawei.MA5600T: +Huawei.MA5600T +^^^^^^^^^^^^^^ ++------------+-----------------------------------------------------------------------+ +| MR | Title | ++------------+-----------------------------------------------------------------------+ +| :mr:`3022` | Huawei.MA5600T. Fix lstrip on profile parse_table. | ++------------+-----------------------------------------------------------------------+ +| :mr:`3163` | noc/noc#1226 Huawei.MA5600T. Add pattern_more for MA5800-X2 platform. | ++------------+-----------------------------------------------------------------------+ +| :mr:`3163` | noc/noc#1226 Huawei.MA5600T. Add pattern_more for MA5800-X2 platform. | ++------------+-----------------------------------------------------------------------+ +| :mr:`3337` | Huawei. Disable CLI metrics. | ++------------+-----------------------------------------------------------------------+ + + +.. _release-20.1-profile-Huawei.VRP: +Huawei.VRP +^^^^^^^^^^ ++------------+---------------------------------------------------------------------------------+ +| MR | Title | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3105` | Huawei.VRP. Add S3328 to hw_series. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3113` | Huawei.VRP. Fix version and inventory script for CX300 platform. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3116` | noc/noc#1163 Huawei.VRP.get_inventory. Add S8504 slot count. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3126` | noc/noc#1163 Huawei.VRP. Add error_pattern_prompt and fix get_version encoding. | ++------------+---------------------------------------------------------------------------------+ +| :mr:`3345` | Huawei.VRP.get_switchport. Fix getting port vlan on SNMP. | ++------------+---------------------------------------------------------------------------------+ + + +.. _release-20.1-profile-Iskratel.MSAN: +Iskratel.MSAN +^^^^^^^^^^^^^ ++------------+------------------------------------------+ +| MR | Title | ++------------+------------------------------------------+ +| :mr:`3344` | Fix send_on_syntax_error params for py3. | ++------------+------------------------------------------+ + + +.. _release-20.1-profile-Juniper.JUNOS: +Juniper.JUNOS +^^^^^^^^^^^^^ ++------------+----------------------------------------------------------------------------------+ +| MR | Title | ++------------+----------------------------------------------------------------------------------+ +| :mr:`3058` | Juniper.JUNOS.normalizer. Fix detect vrf type. | ++------------+----------------------------------------------------------------------------------+ +| :mr:`3256` | add snmp oid jnxVirtualChassisMemberMacAddBase. fix get_chassis_id Juniper_JUNOS | ++------------+----------------------------------------------------------------------------------+ + + +.. _release-20.1-profile-Qtech.QSW2800: +Qtech.QSW2800 +^^^^^^^^^^^^^ ++------------+-------------------------------------------------------------------------------------------+ +| MR | Title | ++------------+-------------------------------------------------------------------------------------------+ +| :mr:`2960` | Add support for `stack` in QSW-8200-28F-AC-DC | ++------------+-------------------------------------------------------------------------------------------+ +| :mr:`3222` | Qtech.QSW2800.get_capabilities. Fix not supported operation on 'NoneType' and 'int' type. | ++------------+-------------------------------------------------------------------------------------------+ +| :mr:`3343` | Qtech.QSW2800.get_fqdn. Fix py3 pattern encoding. | ++------------+-------------------------------------------------------------------------------------------+ + + +.. _release-20.1-profile-SKS.SKS: +SKS.SKS +^^^^^^^ ++------------+-----------------------------------------------------------------------------------------------------+ +| MR | Title | ++------------+-----------------------------------------------------------------------------------------------------+ +| :mr:`3127` | noc/noc#1180 SKS.SKS. Fix get_spanning_tree designated_port_id and get_inventory unknown E1 module. | ++------------+-----------------------------------------------------------------------------------------------------+ + + +.. _release-20.1-profile-Siklu.EH: +Siklu.EH +^^^^^^^^ ++------------+---------------------------------------------+ +| MR | Title | ++------------+---------------------------------------------+ +| :mr:`3364` | Siklu.EH. Fix cleaned_input to binary data. | ++------------+---------------------------------------------+ + + +.. _release-20.1-profile-rare: +rare +^^^^ ++------------+----------------------------------------------------------------------+ +| MR | Title | ++------------+----------------------------------------------------------------------+ +| :mr:`3038` | Add NSN.hiX56xx.get_inventory script | ++------------+----------------------------------------------------------------------+ +| :mr:`3050` | DCN.DCWL. Fix profile for SNMP | ++------------+----------------------------------------------------------------------+ +| :mr:`3052` | DCN.DCWL.get_version. Fix typo on matchers. | ++------------+----------------------------------------------------------------------+ +| :mr:`3079` | Carelink.SWG. Fix pattern_more on profile. | ++------------+----------------------------------------------------------------------+ +| :mr:`3083` | Qtech.QSW8200.get_lldp_neighbors. Add ifName to port_type. | ++------------+----------------------------------------------------------------------+ +| :mr:`3108` | fix_get_inventory_Eltex_ESR_profile | ++------------+----------------------------------------------------------------------+ +| :mr:`3150` | fix_AlliedTelesis.AT9900_profile | ++------------+----------------------------------------------------------------------+ +| :mr:`3160` | add_get_ifindexes_AlliedTelesis.AT9900_profile | ++------------+----------------------------------------------------------------------+ +| :mr:`3167` | add_get_lldp_neighbors_AlliedTelesis.AT9900 | ++------------+----------------------------------------------------------------------+ +| :mr:`3180` | add_cli_get_lldp_neighbors_AlliedTelesis.AT9900 | ++------------+----------------------------------------------------------------------+ +| :mr:`3186` | add_get_capabilities_AlliedTelesis.AT9900 | ++------------+----------------------------------------------------------------------+ +| :mr:`3196` | Fix get_interfaces for BDCOM.xPON profile | ++------------+----------------------------------------------------------------------+ +| :mr:`3241` | Fix invalid JSON | ++------------+----------------------------------------------------------------------+ +| :mr:`3245` | Fix get_interfaces NSN.TIMOS | ++------------+----------------------------------------------------------------------+ +| :mr:`3298` | fix_get_interfaces - port-channel no has iftype | ++------------+----------------------------------------------------------------------+ +| :mr:`3306` | NSN.TIMOS Fix get_intefaces script | ++------------+----------------------------------------------------------------------+ +| :mr:`3308` | Iscratel.ESCOM fix profile | ++------------+----------------------------------------------------------------------+ +| :mr:`3332` | Iskratel.ESCOM fix lldp neigborg script | ++------------+----------------------------------------------------------------------+ +| :mr:`3346` | py3. Cleanup get_lldp_neighbors script for SNMP. | ++------------+----------------------------------------------------------------------+ +| :mr:`3360` | fix_get_config_NSN.hiX56xx | ++------------+----------------------------------------------------------------------+ +| :mr:`3361` | fix_pattern_more_Huawei_VRP3 | ++------------+----------------------------------------------------------------------+ +| :mr:`3369` | Fix Check metrics collect on DCN and Rotek profiles. | ++------------+----------------------------------------------------------------------+ +| :mr:`3370` | py3: Convert telnet_send_on_connect to binary. | ++------------+----------------------------------------------------------------------+ +| :mr:`3382` | NSN.TIMOS.get_interfaces. Fix empty mac address on tunnel interface. | ++------------+----------------------------------------------------------------------+ -- GitLab From 0de35c9168efc088e5689b54f0b06902fc1d4d69 Mon Sep 17 00:00:00 2001 From: Dmitry Volodin Date: Wed, 1 Apr 2020 17:37:30 +0300 Subject: [PATCH 2/2] Fix --- docs/src/en/releases/release-20.1.rst | 2 -- 1 file changed, 2 deletions(-) diff --git a/docs/src/en/releases/release-20.1.rst b/docs/src/en/releases/release-20.1.rst index c381e0bb87..ed08324b64 100644 --- a/docs/src/en/releases/release-20.1.rst +++ b/docs/src/en/releases/release-20.1.rst @@ -404,8 +404,6 @@ Bugfixes +------------+------------------------------------------------------------------------------------------------------+ | :mr:`3055` | Fix CH objectprofile datasource bool field. | +------------+------------------------------------------------------------------------------------------------------+ -| :mr:`3055` | Fix CH objectprofile datasource bool field. | -+------------+------------------------------------------------------------------------------------------------------+ | :mr:`3062` | noc/noc#1197 Fix encoding on interfacepath card. | +------------+------------------------------------------------------------------------------------------------------+ | :mr:`3064` | py3 fix beef import encoding. | -- GitLab